2019-01-20 13:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 13:25:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:25:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 13:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-20 13:25:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:25:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:25:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:25:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:25:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:25:03 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-01-20 13:25:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 13:25:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 13:25:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 13:26:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:26:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:26:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:26:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:26:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:26:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:26:03 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-20 13:26:06 [DEBUG   ] Got command RPT from MCS: ref #1228356
2019-01-20 13:26:06 [DEBUG   ] summary = ERROR
2019-01-20 13:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228356  13 58503 48366653 A  ERRORERROR'
2019-01-20 13:26:06 [DEBUG   ] Got command RPT from MCS: ref #1228357
2019-01-20 13:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228357  77 58503 48366654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:26:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 13:26:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 13:26:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 13:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 13:27:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-20 13:27:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:27:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:27:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:27:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:27:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:27:03 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-20 13:27:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 13:27:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 13:27:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 13:28:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 13:28:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:28:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:28:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:28:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:28:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:28:03 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-01-20 13:28:07 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-20 13:28:20 [DEBUG   ] Got command RPT from MCS: ref #1228380
2019-01-20 13:28:20 [DEBUG   ] summary = ERROR
2019-01-20 13:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228380  13 58503 48500817 A  ERRORERROR'
2019-01-20 13:28:21 [DEBUG   ] Got command RPT from MCS: ref #1228381
2019-01-20 13:28:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228381  77 58503 48501021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:28:21 [DEBUG   ] Got command RPT from MCS: ref #1228382
2019-01-20 13:28:21 [DEBUG   ] summary = ERROR
2019-01-20 13:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228382  13 58503 48501225 A  ERRORERROR'
2019-01-20 13:28:21 [DEBUG   ] Got command RPT from MCS: ref #1228383
2019-01-20 13:28:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228383  77 58503 48501417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:28:21 [DEBUG   ] Got command RPT from MCS: ref #1228385
2019-01-20 13:28:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 13:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228385  12 58503 48501621 A  ERRORB™™š'
2019-01-20 13:28:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 13:28:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 13:29:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-20 13:29:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:29:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:29:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:29:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:29:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:29:03 [DEBUG   ] Finished updating board flags in 1.624 seconds
2019-01-20 13:29:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 13:29:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 13:29:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 13:30:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 13:30:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:30:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:30:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:30:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:30:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:30:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:30:03 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-20 13:30:08 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-01-20 13:30:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 13:30:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 13:31:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 13:31:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:31:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:31:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:31:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:31:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:31:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:31:03 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-20 13:31:06 [DEBUG   ] Got command RPT from MCS: ref #1228394
2019-01-20 13:31:06 [DEBUG   ] summary = ERROR
2019-01-20 13:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228394  13 58503 48666657 A  ERRORERROR'
2019-01-20 13:31:06 [DEBUG   ] Got command RPT from MCS: ref #1228395
2019-01-20 13:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228395  77 58503 48666658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:31:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 13:31:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 13:31:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 13:32:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 13:32:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:32:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:32:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:32:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:32:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:32:03 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-20 13:32:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 13:32:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 13:32:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 13:33:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 13:33:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:33:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:33:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:33:03 [WARNING ] (13, 1, 'bot')
2019-01-20 13:33:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:33:03 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-01-20 13:33:08 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2019-01-20 13:33:20 [DEBUG   ] Got command RPT from MCS: ref #1228415
2019-01-20 13:33:20 [DEBUG   ] summary = ERROR
2019-01-20 13:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228415  13 58503 48800905 A  ERRORERROR'
2019-01-20 13:33:21 [DEBUG   ] Got command RPT from MCS: ref #1228416
2019-01-20 13:33:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228416  77 58503 48801097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:33:21 [DEBUG   ] Got command RPT from MCS: ref #1228417
2019-01-20 13:33:21 [DEBUG   ] summary = ERROR
2019-01-20 13:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228417  13 58503 48801301 A  ERRORERROR'
2019-01-20 13:33:21 [DEBUG   ] Got command RPT from MCS: ref #1228418
2019-01-20 13:33:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228418  77 58503 48801505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:33:21 [DEBUG   ] Got command RPT from MCS: ref #1228419
2019-01-20 13:33:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 13:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228419  12 58503 48801697 A  ERRORB˜™š'
2019-01-20 13:33:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 13:33:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 13:34:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:34:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:34:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:34:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:34:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:34:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:34:04 [DEBUG   ] Finished updating board flags in 2.206 seconds
2019-01-20 13:34:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 13:34:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 13:34:49 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-20 13:35:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:35:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:35:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:35:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:35:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:35:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:35:04 [DEBUG   ] Finished updating board flags in 2.218 seconds
2019-01-20 13:35:09 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 13:35:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 13:35:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 13:36:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:36:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:36:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:36:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:36:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:36:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:36:04 [DEBUG   ] Finished updating board flags in 2.179 seconds
2019-01-20 13:36:06 [DEBUG   ] Got command RPT from MCS: ref #1228424
2019-01-20 13:36:06 [DEBUG   ] summary = ERROR
2019-01-20 13:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228424  13 58503 48966649 A  ERRORERROR'
2019-01-20 13:36:06 [DEBUG   ] Got command RPT from MCS: ref #1228425
2019-01-20 13:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228425  77 58503 48966650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:36:09 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-20 13:36:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 13:36:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 13:37:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 13:37:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 13:37:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:37:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:37:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:37:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:37:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:37:04 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-20 13:37:10 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-20 13:37:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 13:37:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 13:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 13:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:38:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:38:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:38:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:38:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:38:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:38:04 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-20 13:38:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 13:38:20 [DEBUG   ] Got command RPT from MCS: ref #1228447
2019-01-20 13:38:20 [DEBUG   ] summary = ERROR
2019-01-20 13:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228447  13 58503 49100977 A  ERRORERROR'
2019-01-20 13:38:21 [DEBUG   ] Got command RPT from MCS: ref #1228448
2019-01-20 13:38:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228448  77 58503 49101181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:38:21 [DEBUG   ] Got command RPT from MCS: ref #1228449
2019-01-20 13:38:21 [DEBUG   ] summary = ERROR
2019-01-20 13:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228449  13 58503 49101385 A  ERRORERROR'
2019-01-20 13:38:21 [DEBUG   ] Got command RPT from MCS: ref #1228450
2019-01-20 13:38:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228450  77 58503 49101577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:38:21 [DEBUG   ] Got command RPT from MCS: ref #1228452
2019-01-20 13:38:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 13:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228452  12 58503 49101781 A  ERRORB™™š'
2019-01-20 13:38:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 13:38:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 13:39:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:39:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:39:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:39:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:39:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:39:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:39:04 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-20 13:39:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 13:39:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 13:39:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 13:40:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:40:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:40:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:40:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:40:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:40:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:40:04 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-20 13:40:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 13:40:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 13:40:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 13:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:41:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:41:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:41:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:41:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:41:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:41:04 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-20 13:41:06 [DEBUG   ] Got command RPT from MCS: ref #1228461
2019-01-20 13:41:06 [DEBUG   ] summary = ERROR
2019-01-20 13:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228461  13 58503 49266653 A  ERRORERROR'
2019-01-20 13:41:06 [DEBUG   ] Got command RPT from MCS: ref #1228462
2019-01-20 13:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228462  77 58503 49266654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:41:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 13:41:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 13:41:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 13:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:42:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:42:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:42:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:42:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:42:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:42:04 [DEBUG   ] Finished updating board flags in 1.639 seconds
2019-01-20 13:42:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 13:42:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 13:42:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 13:43:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 13:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:43:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:43:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:43:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:43:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:43:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:43:04 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-20 13:43:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 13:43:21 [DEBUG   ] Got command RPT from MCS: ref #1228478
2019-01-20 13:43:21 [DEBUG   ] summary = ERROR
2019-01-20 13:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228478  13 58503 49401065 A  ERRORERROR'
2019-01-20 13:43:21 [DEBUG   ] Got command RPT from MCS: ref #1228479
2019-01-20 13:43:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228479  77 58503 49401257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:43:21 [DEBUG   ] Got command RPT from MCS: ref #1228480
2019-01-20 13:43:21 [DEBUG   ] summary = ERROR
2019-01-20 13:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228480  13 58503 49401464 A  ERRORERROR'
2019-01-20 13:43:21 [DEBUG   ] Got command RPT from MCS: ref #1228481
2019-01-20 13:43:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228481  77 58503 49401665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:43:21 [DEBUG   ] Got command RPT from MCS: ref #1228482
2019-01-20 13:43:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 13:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228482  12 58503 49401857 A  ERRORB˜™š'
2019-01-20 13:43:31 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 13:43:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 13:44:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 13:44:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:44:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:44:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:44:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:44:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:44:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:44:04 [DEBUG   ] Finished updating board flags in 1.545 seconds
2019-01-20 13:44:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 13:44:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 13:44:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 13:45:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 13:45:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 13:45:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:45:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:45:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:45:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:45:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:45:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:45:04 [DEBUG   ] Finished updating board flags in 1.431 seconds
2019-01-20 13:45:11 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-20 13:45:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 13:45:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 13:46:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:46:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:46:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:46:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:46:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:46:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:46:04 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-01-20 13:46:06 [DEBUG   ] Got command RPT from MCS: ref #1228487
2019-01-20 13:46:06 [DEBUG   ] summary = ERROR
2019-01-20 13:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228487  13 58503 49566657 A  ERRORERROR'
2019-01-20 13:46:06 [DEBUG   ] Got command RPT from MCS: ref #1228488
2019-01-20 13:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228488  77 58503 49566658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:46:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 13:46:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 13:46:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 13:47:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:47:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 13:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 13:47:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:47:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:47:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:47:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:47:04 [DEBUG   ] Finished updating board flags in 1.431 seconds
2019-01-20 13:47:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 13:47:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 13:47:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 13:48:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 13:48:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 13:48:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:48:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:48:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:48:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:48:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:48:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:48:04 [DEBUG   ] Finished updating board flags in 1.482 seconds
2019-01-20 13:48:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 13:48:21 [DEBUG   ] Got command RPT from MCS: ref #1228510
2019-01-20 13:48:21 [DEBUG   ] summary = ERROR
2019-01-20 13:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228510  13 58503 49701153 A  ERRORERROR'
2019-01-20 13:48:21 [DEBUG   ] Got command RPT from MCS: ref #1228511
2019-01-20 13:48:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228511  77 58503 49701357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:48:21 [DEBUG   ] Got command RPT from MCS: ref #1228512
2019-01-20 13:48:21 [DEBUG   ] summary = ERROR
2019-01-20 13:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228512  13 58503 49701561 A  ERRORERROR'
2019-01-20 13:48:21 [DEBUG   ] Got command RPT from MCS: ref #1228513
2019-01-20 13:48:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228513  77 58503 49701753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:48:21 [DEBUG   ] Got command RPT from MCS: ref #1228515
2019-01-20 13:48:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 13:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228515  12 58503 49701957 A  ERRORB™™š'
2019-01-20 13:48:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 13:48:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 13:49:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:49:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:49:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:49:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:49:04 [WARNING ] (13, 1, 'bot')
2019-01-20 13:49:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:49:04 [DEBUG   ] Finished updating board flags in 1.483 seconds
2019-01-20 13:49:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 13:49:32 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-20 13:49:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 13:50:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 13:50:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:50:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:50:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:50:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:50:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:50:05 [DEBUG   ] Finished updating board flags in 2.197 seconds
2019-01-20 13:50:12 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2019-01-20 13:50:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 13:50:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 13:51:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:51:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:51:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:51:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:51:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:51:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:51:05 [DEBUG   ] Finished updating board flags in 1.955 seconds
2019-01-20 13:51:06 [DEBUG   ] Got command RPT from MCS: ref #1228524
2019-01-20 13:51:06 [DEBUG   ] summary = ERROR
2019-01-20 13:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228524  13 58503 49866649 A  ERRORERROR'
2019-01-20 13:51:06 [DEBUG   ] Got command RPT from MCS: ref #1228525
2019-01-20 13:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228525  77 58503 49866650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:51:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 13:51:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 13:51:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 13:52:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:52:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:52:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:52:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:52:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:52:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:52:05 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-20 13:52:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 13:52:32 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 13:52:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 13:53:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:53:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:53:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:53:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:53:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:53:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:53:05 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-20 13:53:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 13:53:21 [DEBUG   ] Got command RPT from MCS: ref #1228545
2019-01-20 13:53:21 [DEBUG   ] summary = ERROR
2019-01-20 13:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228545  13 58503 50001229 A  ERRORERROR'
2019-01-20 13:53:21 [DEBUG   ] Got command RPT from MCS: ref #1228546
2019-01-20 13:53:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228546  77 58503 50001433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:53:21 [DEBUG   ] Got command RPT from MCS: ref #1228547
2019-01-20 13:53:21 [DEBUG   ] summary = ERROR
2019-01-20 13:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228547  13 58503 50001637 A  ERRORERROR'
2019-01-20 13:53:21 [DEBUG   ] Got command RPT from MCS: ref #1228548
2019-01-20 13:53:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228548  77 58503 50001841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:53:22 [DEBUG   ] Got command RPT from MCS: ref #1228549
2019-01-20 13:53:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 13:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228549  12 58503 50002033 A  ERRORB˜™š'
2019-01-20 13:53:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 13:53:52 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 13:54:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:54:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:54:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:54:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:54:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:54:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:54:05 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-20 13:54:12 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-01-20 13:54:33 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-20 13:54:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 13:55:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 13:55:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:55:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:55:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:55:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:55:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:55:05 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-01-20 13:55:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 13:55:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 13:55:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 13:56:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:56:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:56:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:56:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:56:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:56:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:56:05 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-20 13:56:06 [DEBUG   ] Got command RPT from MCS: ref #1228554
2019-01-20 13:56:06 [DEBUG   ] summary = ERROR
2019-01-20 13:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228554  13 58503 50166653 A  ERRORERROR'
2019-01-20 13:56:06 [DEBUG   ] Got command RPT from MCS: ref #1228555
2019-01-20 13:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228555  77 58503 50166654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:56:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 13:56:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 13:56:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 13:57:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-20 13:57:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:57:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:57:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:57:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:57:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:57:05 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-20 13:57:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 13:57:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 13:57:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 13:58:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:58:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:58:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:58:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:58:05 [WARNING ] (13, 1, 'bot')
2019-01-20 13:58:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:58:05 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-01-20 13:58:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 13:58:21 [DEBUG   ] Got command RPT from MCS: ref #1228573
2019-01-20 13:58:21 [DEBUG   ] summary = ERROR
2019-01-20 13:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228573  13 58503 50301317 A  ERRORERROR'
2019-01-20 13:58:21 [DEBUG   ] Got command RPT from MCS: ref #1228574
2019-01-20 13:58:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228574  77 58503 50301521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:58:21 [DEBUG   ] Got command RPT from MCS: ref #1228575
2019-01-20 13:58:21 [DEBUG   ] summary = ERROR
2019-01-20 13:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228575  13 58503 50301713 A  ERRORERROR'
2019-01-20 13:58:21 [DEBUG   ] Got command RPT from MCS: ref #1228576
2019-01-20 13:58:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 13:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228576  77 58503 50301917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 13:58:22 [DEBUG   ] Got command RPT from MCS: ref #1228578
2019-01-20 13:58:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 13:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228578  12 58503 50302121 A  ERRORB˜™š'
2019-01-20 13:58:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 13:58:53 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 13:59:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 13:59:06 [WARNING ] (13, 1, 'bot')
2019-01-20 13:59:06 [WARNING ] (13, 1, 'bot')
2019-01-20 13:59:06 [WARNING ] (13, 1, 'bot')
2019-01-20 13:59:06 [WARNING ] (13, 1, 'bot')
2019-01-20 13:59:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 13:59:06 [DEBUG   ] Finished updating board flags in 2.232 seconds
2019-01-20 13:59:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 13:59:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 13:59:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 14:00:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:00:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:00:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:00:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:00:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:00:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:00:06 [DEBUG   ] Finished updating board flags in 2.215 seconds
2019-01-20 14:00:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 14:00:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 14:00:54 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-20 14:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 14:01:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 14:01:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:01:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:01:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:01:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:01:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:01:06 [DEBUG   ] Finished updating board flags in 2.157 seconds
2019-01-20 14:01:06 [DEBUG   ] Got command RPT from MCS: ref #1228587
2019-01-20 14:01:06 [DEBUG   ] summary = ERROR
2019-01-20 14:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228587  13 58503 50466661 A  ERRORERROR'
2019-01-20 14:01:06 [DEBUG   ] Got command RPT from MCS: ref #1228588
2019-01-20 14:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228588  77 58503 50466662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:01:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 14:01:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 14:01:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 14:02:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:02:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:02:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:02:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:02:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:02:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:02:06 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-20 14:02:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 14:02:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 14:02:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 14:03:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:03:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:03:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:03:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:03:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:03:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:03:06 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-01-20 14:03:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 14:03:21 [DEBUG   ] Got command RPT from MCS: ref #1228608
2019-01-20 14:03:21 [DEBUG   ] summary = ERROR
2019-01-20 14:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228608  13 58503 50601397 A  ERRORERROR'
2019-01-20 14:03:21 [DEBUG   ] Got command RPT from MCS: ref #1228609
2019-01-20 14:03:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228609  77 58503 50601601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:03:21 [DEBUG   ] Got command RPT from MCS: ref #1228610
2019-01-20 14:03:21 [DEBUG   ] summary = ERROR
2019-01-20 14:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228610  13 58503 50601793 A  ERRORERROR'
2019-01-20 14:03:21 [DEBUG   ] Got command RPT from MCS: ref #1228611
2019-01-20 14:03:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228611  77 58503 50601997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:03:22 [DEBUG   ] Got command RPT from MCS: ref #1228612
2019-01-20 14:03:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 14:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228612  12 58503 50602201 A  ERRORB™™š'
2019-01-20 14:03:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 14:03:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-20 14:04:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:04:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:04:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:04:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:04:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:04:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:04:06 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-01-20 14:04:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 14:04:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 14:04:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 14:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:05:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:05:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:05:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:05:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:05:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:05:06 [DEBUG   ] Finished updating board flags in 1.970 seconds
2019-01-20 14:05:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 14:05:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 14:05:54 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-20 14:06:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 14:06:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:06:06 [DEBUG   ] Got command RPT from MCS: ref #1228617
2019-01-20 14:06:06 [DEBUG   ] summary = ERROR
2019-01-20 14:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228617  13 58503 50766662 A  ERRORERROR'
2019-01-20 14:06:06 [DEBUG   ] Got command RPT from MCS: ref #1228618
2019-01-20 14:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228618  77 58503 50766663 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:06:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:06:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:06:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:06:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:06:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:06:06 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-20 14:06:14 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-20 14:06:35 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-20 14:06:55 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-20 14:07:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:07:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:07:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:07:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:07:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:07:06 [DEBUG   ] Finished updating board flags in 1.780 seconds
2019-01-20 14:07:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 14:07:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 14:07:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 14:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 14:08:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:08:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:08:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:08:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:08:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:08:06 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-20 14:08:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 14:08:21 [DEBUG   ] Got command RPT from MCS: ref #1228640
2019-01-20 14:08:21 [DEBUG   ] summary = ERROR
2019-01-20 14:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228640  13 58503 50901481 A  ERRORERROR'
2019-01-20 14:08:21 [DEBUG   ] Got command RPT from MCS: ref #1228641
2019-01-20 14:08:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228641  77 58503 50901685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:08:21 [DEBUG   ] Got command RPT from MCS: ref #1228642
2019-01-20 14:08:21 [DEBUG   ] summary = ERROR
2019-01-20 14:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228642  13 58503 50901877 A  ERRORERROR'
2019-01-20 14:08:22 [DEBUG   ] Got command RPT from MCS: ref #1228643
2019-01-20 14:08:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228643  77 58503 50902081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:08:22 [DEBUG   ] Got command RPT from MCS: ref #1228645
2019-01-20 14:08:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 14:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228645  12 58503 50902285 A  ERRORB˜™š'
2019-01-20 14:08:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 14:08:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 14:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:09:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:09:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:09:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:09:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:09:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:09:06 [DEBUG   ] Finished updating board flags in 1.632 seconds
2019-01-20 14:09:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 14:09:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 14:09:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 14:10:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:10:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:10:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:10:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:10:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:10:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:10:06 [DEBUG   ] Finished updating board flags in 1.571 seconds
2019-01-20 14:10:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 14:10:35 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-20 14:10:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 14:11:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:11:06 [DEBUG   ] Got command RPT from MCS: ref #1228654
2019-01-20 14:11:06 [DEBUG   ] summary = ERROR
2019-01-20 14:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228654  13 58503 51066658 A  ERRORERROR'
2019-01-20 14:11:06 [DEBUG   ] Got command RPT from MCS: ref #1228655
2019-01-20 14:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:11:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228655  77 58503 51066659 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:11:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:11:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:11:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:11:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:11:06 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-20 14:11:15 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-20 14:11:36 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2019-01-20 14:11:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 14:12:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:12:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:12:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:12:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:12:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:12:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:12:06 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-01-20 14:12:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 14:12:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 14:12:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 14:13:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:13:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:13:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:13:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:13:06 [WARNING ] (13, 1, 'bot')
2019-01-20 14:13:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:13:06 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-01-20 14:13:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 14:13:21 [DEBUG   ] Got command RPT from MCS: ref #1228671
2019-01-20 14:13:21 [DEBUG   ] summary = ERROR
2019-01-20 14:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228671  13 58503 51201561 A  ERRORERROR'
2019-01-20 14:13:21 [DEBUG   ] Got command RPT from MCS: ref #1228672
2019-01-20 14:13:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228672  77 58503 51201765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:13:21 [DEBUG   ] Got command RPT from MCS: ref #1228673
2019-01-20 14:13:21 [DEBUG   ] summary = ERROR
2019-01-20 14:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228673  13 58503 51201957 A  ERRORERROR'
2019-01-20 14:13:22 [DEBUG   ] Got command RPT from MCS: ref #1228674
2019-01-20 14:13:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228674  77 58503 51202161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:13:22 [DEBUG   ] Got command RPT from MCS: ref #1228675
2019-01-20 14:13:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 14:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228675  12 58503 51202365 A  ERRORB˜™š'
2019-01-20 14:13:36 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 14:13:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 14:14:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:14:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:14:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:14:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:14:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:14:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:14:07 [DEBUG   ] Finished updating board flags in 2.032 seconds
2019-01-20 14:14:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 14:14:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 14:14:56 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 14:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 14:15:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:15:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:15:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:15:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:15:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:15:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:15:07 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-01-20 14:15:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 14:15:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 14:15:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 14:16:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:16:06 [DEBUG   ] Got command RPT from MCS: ref #1228680
2019-01-20 14:16:06 [DEBUG   ] summary = ERROR
2019-01-20 14:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228680  13 58503 51366666 A  ERRORERROR'
2019-01-20 14:16:06 [DEBUG   ] Got command RPT from MCS: ref #1228681
2019-01-20 14:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228681  77 58503 51366666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:16:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:16:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:16:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:16:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:16:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:16:07 [DEBUG   ] Finished updating board flags in 1.976 seconds
2019-01-20 14:16:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 14:16:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 14:16:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 14:17:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:17:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:17:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:17:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:17:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:17:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:17:07 [DEBUG   ] Finished updating board flags in 1.869 seconds
2019-01-20 14:17:17 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2019-01-20 14:17:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-20 14:17:57 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-20 14:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:18:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:18:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:18:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:18:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:18:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:18:07 [DEBUG   ] Finished updating board flags in 1.764 seconds
2019-01-20 14:18:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 14:18:21 [DEBUG   ] Got command RPT from MCS: ref #1228703
2019-01-20 14:18:21 [DEBUG   ] summary = ERROR
2019-01-20 14:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228703  13 58503 51501641 A  ERRORERROR'
2019-01-20 14:18:21 [DEBUG   ] Got command RPT from MCS: ref #1228704
2019-01-20 14:18:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228704  77 58503 51501845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:18:22 [DEBUG   ] Got command RPT from MCS: ref #1228705
2019-01-20 14:18:22 [DEBUG   ] summary = ERROR
2019-01-20 14:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228705  13 58503 51502037 A  ERRORERROR'
2019-01-20 14:18:22 [DEBUG   ] Got command RPT from MCS: ref #1228706
2019-01-20 14:18:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228706  77 58503 51502241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:18:22 [DEBUG   ] Got command RPT from MCS: ref #1228708
2019-01-20 14:18:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 14:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228708  12 58503 51502445 A  ERRORB—™š'
2019-01-20 14:18:37 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 14:18:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 14:19:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 14:19:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:19:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:19:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:19:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:19:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:19:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:19:07 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-20 14:19:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 14:19:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 14:19:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 14:20:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 14:20:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:20:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:20:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:20:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:20:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:20:07 [DEBUG   ] Finished updating board flags in 1.566 seconds
2019-01-20 14:20:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 14:20:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 14:20:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 14:21:06 [DEBUG   ] Got command RPT from MCS: ref #1228717
2019-01-20 14:21:06 [DEBUG   ] summary = ERROR
2019-01-20 14:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228717  13 58503 51666666 A  ERRORERROR'
2019-01-20 14:21:06 [DEBUG   ] Got command RPT from MCS: ref #1228718
2019-01-20 14:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228718  77 58503 51666666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:21:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:21:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:21:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:21:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:21:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:21:07 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-20 14:21:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 14:21:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 14:21:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 14:22:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:22:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:22:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:22:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:22:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:22:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:22:07 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-20 14:22:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 14:22:37 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 14:22:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 14:23:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 14:23:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 14:23:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:23:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:23:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:23:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:23:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:23:08 [DEBUG   ] Finished updating board flags in 2.215 seconds
2019-01-20 14:23:18 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-20 14:23:21 [DEBUG   ] Got command RPT from MCS: ref #1228738
2019-01-20 14:23:21 [DEBUG   ] summary = ERROR
2019-01-20 14:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228738  13 58503 51801725 A  ERRORERROR'
2019-01-20 14:23:21 [DEBUG   ] Got command RPT from MCS: ref #1228739
2019-01-20 14:23:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228739  77 58503 51801929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:23:22 [DEBUG   ] Got command RPT from MCS: ref #1228740
2019-01-20 14:23:22 [DEBUG   ] summary = ERROR
2019-01-20 14:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228740  13 58503 51802133 A  ERRORERROR'
2019-01-20 14:23:22 [DEBUG   ] Got command RPT from MCS: ref #1228741
2019-01-20 14:23:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228741  77 58503 51802325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:23:22 [DEBUG   ] Got command RPT from MCS: ref #1228742
2019-01-20 14:23:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 14:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228742  12 58503 51802529 A  ERRORB˜™š'
2019-01-20 14:23:38 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 14:23:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 14:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:24:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:24:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:24:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:24:07 [WARNING ] (13, 1, 'bot')
2019-01-20 14:24:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:24:07 [DEBUG   ] Finished updating board flags in 1.318 seconds
2019-01-20 14:24:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 14:24:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 14:24:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 14:25:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 14:25:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:25:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:25:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:25:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:25:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:25:08 [DEBUG   ] Finished updating board flags in 2.089 seconds
2019-01-20 14:25:18 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2019-01-20 14:25:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 14:25:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 14:26:06 [DEBUG   ] Got command RPT from MCS: ref #1228747
2019-01-20 14:26:06 [DEBUG   ] summary = ERROR
2019-01-20 14:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228747  13 58503 51966666 A  ERRORERROR'
2019-01-20 14:26:06 [DEBUG   ] Got command RPT from MCS: ref #1228748
2019-01-20 14:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228748  77 58503 51966666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:26:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:26:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:26:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:26:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:26:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:26:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:26:08 [DEBUG   ] Finished updating board flags in 2.002 seconds
2019-01-20 14:26:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 14:26:38 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 14:26:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 14:27:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:27:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 14:27:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:27:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:27:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:27:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:27:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:27:08 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-20 14:27:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 14:27:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-20 14:27:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 14:28:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:28:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:28:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:28:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:28:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:28:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:28:08 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-20 14:28:19 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-20 14:28:21 [DEBUG   ] Got command RPT from MCS: ref #1228766
2019-01-20 14:28:21 [DEBUG   ] summary = ERROR
2019-01-20 14:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228766  13 58503 52101805 A  ERRORERROR'
2019-01-20 14:28:22 [DEBUG   ] Got command RPT from MCS: ref #1228767
2019-01-20 14:28:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228767  77 58503 52102009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:28:22 [DEBUG   ] Got command RPT from MCS: ref #1228768
2019-01-20 14:28:22 [DEBUG   ] summary = ERROR
2019-01-20 14:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228768  13 58503 52102213 A  ERRORERROR'
2019-01-20 14:28:22 [DEBUG   ] Got command RPT from MCS: ref #1228770
2019-01-20 14:28:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228770  77 58503 52102417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:28:22 [DEBUG   ] Got command RPT from MCS: ref #1228771
2019-01-20 14:28:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 14:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228771  12 58503 52102609 A  ERRORB˜™š'
2019-01-20 14:28:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-20 14:28:59 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-20 14:29:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:29:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:29:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:29:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:29:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:29:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:29:08 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-20 14:29:19 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-20 14:29:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 14:29:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 14:30:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:30:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 14:30:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:30:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:30:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:30:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:30:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:30:08 [DEBUG   ] Finished updating board flags in 1.770 seconds
2019-01-20 14:30:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 14:30:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 14:30:59 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 14:31:06 [DEBUG   ] Got command RPT from MCS: ref #1228780
2019-01-20 14:31:06 [DEBUG   ] summary = ERROR
2019-01-20 14:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228780  13 58503 52266669 A  ERRORERROR'
2019-01-20 14:31:06 [DEBUG   ] Got command RPT from MCS: ref #1228781
2019-01-20 14:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228781  77 58503 52266670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 14:31:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:31:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:31:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:31:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:31:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:31:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:31:08 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-01-20 14:31:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 14:31:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 14:31:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 14:32:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 14:32:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:32:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-01-20 14:32:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:32:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:32:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:32:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:32:08 [WARNING ] (25, 5, 'bot')
2019-01-20 14:32:08 [WARNING ] (25, 5, 'bot')
2019-01-20 14:32:08 [WARNING ] (25, 5, 'bot')
2019-01-20 14:32:08 [WARNING ] (25, 5, 'bot')
2019-01-20 14:32:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:32:08 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-01-20 14:32:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-20 14:32:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 14:32:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 14:33:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:33:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:33:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:33:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:33:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:33:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:33:08 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-20 14:33:20 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-20 14:33:21 [DEBUG   ] Got command RPT from MCS: ref #1228801
2019-01-20 14:33:21 [DEBUG   ] summary = ERROR
2019-01-20 14:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228801  13 58503 52401901 A  ERRORERROR'
2019-01-20 14:33:22 [DEBUG   ] Got command RPT from MCS: ref #1228802
2019-01-20 14:33:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228802  77 58503 52402093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:33:22 [DEBUG   ] Got command RPT from MCS: ref #1228803
2019-01-20 14:33:22 [DEBUG   ] summary = ERROR
2019-01-20 14:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228803  13 58503 52402297 A  ERRORERROR'
2019-01-20 14:33:22 [DEBUG   ] Got command RPT from MCS: ref #1228804
2019-01-20 14:33:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228804  77 58503 52402501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:33:22 [DEBUG   ] Got command RPT from MCS: ref #1228805
2019-01-20 14:33:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 14:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228805  12 58503 52402705 A  ERRORB˜™š'
2019-01-20 14:33:39 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-20 14:34:00 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-20 14:34:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 14:34:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:34:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 14:34:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:34:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:34:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:34:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:34:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:34:08 [DEBUG   ] Finished updating board flags in 1.400 seconds
2019-01-20 14:34:20 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 14:34:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-20 14:35:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 14:35:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:35:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 14:35:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:35:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:35:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:35:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:35:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:35:08 [DEBUG   ] Finished updating board flags in 1.394 seconds
2019-01-20 14:35:20 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-20 14:35:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 14:36:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-20 14:36:06 [DEBUG   ] Got command RPT from MCS: ref #1228810
2019-01-20 14:36:06 [DEBUG   ] summary = ERROR
2019-01-20 14:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228810  13 58503 52566665 A  ERRORERROR'
2019-01-20 14:36:06 [DEBUG   ] Got command RPT from MCS: ref #1228811
2019-01-20 14:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228811  77 58503 52566666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:36:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:36:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:36:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:36:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:36:08 [WARNING ] (13, 1, 'bot')
2019-01-20 14:36:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:36:08 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-01-20 14:36:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 14:36:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 14:37:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 14:37:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:37:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:37:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:37:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:37:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:37:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:37:09 [DEBUG   ] Finished updating board flags in 2.043 seconds
2019-01-20 14:37:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 14:37:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 14:38:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 14:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:38:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:38:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:38:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:38:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:38:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:38:09 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-20 14:38:21 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-20 14:38:21 [DEBUG   ] Got command RPT from MCS: ref #1228833
2019-01-20 14:38:21 [DEBUG   ] summary = ERROR
2019-01-20 14:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228833  13 58503 52701981 A  ERRORERROR'
2019-01-20 14:38:22 [DEBUG   ] Got command RPT from MCS: ref #1228834
2019-01-20 14:38:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228834  77 58503 52702185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:38:22 [DEBUG   ] Got command RPT from MCS: ref #1228835
2019-01-20 14:38:22 [DEBUG   ] summary = ERROR
2019-01-20 14:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228835  13 58503 52702389 A  ERRORERROR'
2019-01-20 14:38:22 [DEBUG   ] Got command RPT from MCS: ref #1228837
2019-01-20 14:38:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228837  77 58503 52702581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:38:22 [DEBUG   ] Got command RPT from MCS: ref #1228838
2019-01-20 14:38:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 14:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228838  12 58503 52702785 A  ERRORB˜™š'
2019-01-20 14:38:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 14:39:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 14:39:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:39:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 14:39:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:39:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:39:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:39:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:39:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:39:09 [DEBUG   ] Finished updating board flags in 1.994 seconds
2019-01-20 14:39:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 14:39:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 14:40:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 14:40:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 14:40:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:40:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:40:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:40:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:40:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:40:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:40:09 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-01-20 14:40:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 14:40:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 14:41:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-01-20 14:41:06 [DEBUG   ] Got command RPT from MCS: ref #1228847
2019-01-20 14:41:06 [DEBUG   ] summary = ERROR
2019-01-20 14:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228847  13 58503 52866669 A  ERRORERROR'
2019-01-20 14:41:06 [DEBUG   ] Got command RPT from MCS: ref #1228848
2019-01-20 14:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228848  77 58503 52866670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:41:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:41:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:41:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:41:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:41:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:41:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:41:09 [DEBUG   ] Finished updating board flags in 1.776 seconds
2019-01-20 14:41:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 14:41:41 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 14:42:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-01-20 14:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:42:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:42:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:42:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:42:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:42:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:42:09 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-20 14:42:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-20 14:42:42 [DEBUG   ] Finished updating ant stats in 1.599 seconds
2019-01-20 14:43:01 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-20 14:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 14:43:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:43:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:43:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:43:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:43:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:43:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:43:09 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-01-20 14:43:22 [DEBUG   ] Got command RPT from MCS: ref #1228864
2019-01-20 14:43:22 [DEBUG   ] summary = ERROR
2019-01-20 14:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228864  13 58503 53002073 A  ERRORERROR'
2019-01-20 14:43:22 [DEBUG   ] Got command RPT from MCS: ref #1228865
2019-01-20 14:43:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228865  77 58503 53002265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:43:22 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-20 14:43:22 [DEBUG   ] Got command RPT from MCS: ref #1228866
2019-01-20 14:43:22 [DEBUG   ] summary = ERROR
2019-01-20 14:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228866  13 58503 53002469 A  ERRORERROR'
2019-01-20 14:43:22 [DEBUG   ] Got command RPT from MCS: ref #1228867
2019-01-20 14:43:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228867  77 58503 53002673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:43:22 [DEBUG   ] Got command RPT from MCS: ref #1228868
2019-01-20 14:43:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 14:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228868  12 58503 53002877 A  ERRORB˜™š'
2019-01-20 14:43:42 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 14:44:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 14:44:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:44:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:44:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:44:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:44:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:44:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:44:09 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-20 14:44:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 14:44:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-20 14:45:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 14:45:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 14:45:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:45:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:45:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:45:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:45:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:45:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:45:09 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-20 14:45:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 14:45:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 14:46:00 [DEBUG   ] Got command TBN from MCS: ref #1228873
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-20 14:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1228873   8 58503 53160562 A  ERROR'
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547995562']
2019-01-20 14:46:00 [DEBUG   ] spawn_process: at 2019-01-20 14:46:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547995562']
2019-01-20 14:46:00 [INFO    ] Finished spawning TBN in 0.177 s
2019-01-20 14:46:02 [DEBUG   ] Finished updating ant stats in 0.933 seconds
2019-01-20 14:46:06 [DEBUG   ] Got command RPT from MCS: ref #1228874
2019-01-20 14:46:06 [DEBUG   ] summary = ERROR
2019-01-20 14:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228874  13 58503 53166669 A  ERRORERROR'
2019-01-20 14:46:06 [DEBUG   ] Got command RPT from MCS: ref #1228875
2019-01-20 14:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228875  77 58503 53166670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:46:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 14:46:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:46:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:46:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:46:09 [WARNING ] (13, 1, 'bot')
2019-01-20 14:46:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:46:09 [DEBUG   ] Finished updating board flags in 1.350 seconds
2019-01-20 14:46:22 [DEBUG   ] Finished updating ant stats in 0.869 seconds
2019-01-20 14:46:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 14:47:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 14:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:47:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:47:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:47:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:47:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:47:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:47:10 [DEBUG   ] Finished updating board flags in 2.066 seconds
2019-01-20 14:47:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 14:47:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 14:48:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 14:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:48:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:48:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:48:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:48:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:48:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:48:10 [DEBUG   ] Finished updating board flags in 2.027 seconds
2019-01-20 14:48:22 [DEBUG   ] Got command RPT from MCS: ref #1228897
2019-01-20 14:48:22 [DEBUG   ] summary = ERROR
2019-01-20 14:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228897  13 58503 53302154 A  ERRORERROR'
2019-01-20 14:48:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 14:48:22 [DEBUG   ] Got command RPT from MCS: ref #1228898
2019-01-20 14:48:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228898  77 58503 53302361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:48:22 [DEBUG   ] Got command RPT from MCS: ref #1228899
2019-01-20 14:48:22 [DEBUG   ] summary = ERROR
2019-01-20 14:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228899  13 58503 53302561 A  ERRORERROR'
2019-01-20 14:48:22 [DEBUG   ] Got command RPT from MCS: ref #1228901
2019-01-20 14:48:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228901  77 58503 53302753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:48:22 [DEBUG   ] Got command RPT from MCS: ref #1228902
2019-01-20 14:48:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 14:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228902  12 58503 53302957 A  ERRORB˜™š'
2019-01-20 14:48:43 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 14:49:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 14:49:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 14:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:49:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:49:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:49:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:49:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:49:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:49:10 [DEBUG   ] Finished updating board flags in 1.971 seconds
2019-01-20 14:49:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 14:49:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 14:50:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 14:50:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 14:50:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:50:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:50:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:50:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:50:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:50:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:50:10 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-20 14:50:11 [DEBUG   ] Got command TBW from MCS: ref #1228912
2019-01-20 14:50:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-20 14:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1228912   8 58503 53411634 A  ERROR'
2019-01-20 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-20 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-20 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-20 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-20 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-20 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-20 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-20 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-20 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-20 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-20 14:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-20 14:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-20 14:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-20 14:50:15 [DEBUG   ] spawn_process: at 2019-01-20 14:50:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-20 14:50:15 [INFO    ] Finished spawning TBW
2019-01-20 14:51:06 [DEBUG   ] Got command RPT from MCS: ref #1228915
2019-01-20 14:51:06 [DEBUG   ] summary = ERROR
2019-01-20 14:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228915  13 58503 53466661 A  ERRORERROR'
2019-01-20 14:51:06 [DEBUG   ] Got command RPT from MCS: ref #1228916
2019-01-20 14:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228916  77 58503 53466662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:51:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:51:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:51:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:51:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:51:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:51:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:51:10 [DEBUG   ] Finished updating board flags in 1.745 seconds
2019-01-20 14:52:03 [INFO    ] __waitForTBW - TBW finished in 108.705 s
2019-01-20 14:52:04 [DEBUG   ] Finished updating ant stats in 0.426 seconds
2019-01-20 14:52:04 [INFO    ] Started antennas statistics background thread
2019-01-20 14:52:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547995926']
2019-01-20 14:52:04 [DEBUG   ] spawn_process: at 2019-01-20 14:52:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547995926']
2019-01-20 14:52:04 [INFO    ] Finished spawning TBN in 0.049 s
2019-01-20 14:52:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:52:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 14:52:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:52:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:52:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:52:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:52:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:52:10 [DEBUG   ] Finished updating board flags in 1.449 seconds
2019-01-20 14:52:24 [DEBUG   ] Finished updating ant stats in 0.466 seconds
2019-01-20 14:52:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 14:53:04 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-20 14:53:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:53:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:53:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:53:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:53:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:53:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:53:10 [DEBUG   ] Finished updating board flags in 1.605 seconds
2019-01-20 14:53:22 [DEBUG   ] Got command RPT from MCS: ref #1228941
2019-01-20 14:53:22 [DEBUG   ] summary = ERROR
2019-01-20 14:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228941  13 58503 53602241 A  ERRORERROR'
2019-01-20 14:53:22 [DEBUG   ] Got command RPT from MCS: ref #1228942
2019-01-20 14:53:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228942  77 58503 53602445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:53:22 [DEBUG   ] Got command RPT from MCS: ref #1228943
2019-01-20 14:53:22 [DEBUG   ] summary = ERROR
2019-01-20 14:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228943  13 58503 53602637 A  ERRORERROR'
2019-01-20 14:53:22 [DEBUG   ] Got command RPT from MCS: ref #1228944
2019-01-20 14:53:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228944  77 58503 53602841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:53:23 [DEBUG   ] Got command RPT from MCS: ref #1228945
2019-01-20 14:53:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 14:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228945  12 58503 53603045 A  ERRORB˜™š'
2019-01-20 14:53:25 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-20 14:53:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-20 14:54:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 14:54:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 14:54:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:54:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:54:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:54:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:54:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:54:10 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-20 14:54:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 14:54:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 14:55:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 14:55:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 14:55:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:55:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 14:55:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:55:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:55:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:55:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:55:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:55:10 [DEBUG   ] Finished updating board flags in 1.579 seconds
2019-01-20 14:55:25 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 14:55:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 14:56:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 14:56:06 [DEBUG   ] Got command RPT from MCS: ref #1228950
2019-01-20 14:56:06 [DEBUG   ] summary = ERROR
2019-01-20 14:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228950  13 58503 53766669 A  ERRORERROR'
2019-01-20 14:56:06 [DEBUG   ] Got command RPT from MCS: ref #1228951
2019-01-20 14:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228951  77 58503 53766670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:56:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:56:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:56:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:56:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:56:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:56:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:56:10 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-20 14:56:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 14:56:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 14:57:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 14:57:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:57:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 14:57:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:57:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:57:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:57:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:57:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:57:10 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-01-20 14:57:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 14:57:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 14:58:05 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 14:58:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 14:58:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:58:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:58:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:58:10 [WARNING ] (13, 1, 'bot')
2019-01-20 14:58:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:58:10 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-01-20 14:58:22 [DEBUG   ] Got command RPT from MCS: ref #1228969
2019-01-20 14:58:22 [DEBUG   ] summary = ERROR
2019-01-20 14:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228969  13 58503 53902325 A  ERRORERROR'
2019-01-20 14:58:22 [DEBUG   ] Got command RPT from MCS: ref #1228970
2019-01-20 14:58:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228970  77 58503 53902529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:58:22 [DEBUG   ] Got command RPT from MCS: ref #1228971
2019-01-20 14:58:22 [DEBUG   ] summary = ERROR
2019-01-20 14:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228971  13 58503 53902721 A  ERRORERROR'
2019-01-20 14:58:22 [DEBUG   ] Got command RPT from MCS: ref #1228973
2019-01-20 14:58:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 14:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228973  77 58503 53902925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 14:58:23 [DEBUG   ] Got command RPT from MCS: ref #1228974
2019-01-20 14:58:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 14:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228974  12 58503 53903129 A  ERRORB˜™š'
2019-01-20 14:58:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 14:58:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 14:59:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 14:59:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 14:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 14:59:11 [WARNING ] (13, 1, 'bot')
2019-01-20 14:59:11 [WARNING ] (13, 1, 'bot')
2019-01-20 14:59:11 [WARNING ] (13, 1, 'bot')
2019-01-20 14:59:11 [WARNING ] (13, 1, 'bot')
2019-01-20 14:59:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 14:59:11 [DEBUG   ] Finished updating board flags in 2.053 seconds
2019-01-20 14:59:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 14:59:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 15:00:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 15:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:00:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:00:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:00:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:00:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:00:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:00:11 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-20 15:00:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-20 15:00:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 15:01:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 15:01:06 [DEBUG   ] Got command RPT from MCS: ref #1228983
2019-01-20 15:01:06 [DEBUG   ] summary = ERROR
2019-01-20 15:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228983  13 58503 54066673 A  ERRORERROR'
2019-01-20 15:01:06 [DEBUG   ] Got command RPT from MCS: ref #1228984
2019-01-20 15:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1228984  77 58503 54066674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:01:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:01:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:01:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:01:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:01:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:01:11 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-20 15:01:26 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 15:01:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-20 15:02:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 15:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:02:11 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 15:02:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:02:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:02:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:02:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:02:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:02:11 [DEBUG   ] Finished updating board flags in 1.827 seconds
2019-01-20 15:02:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 15:02:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 15:03:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-20 15:03:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:03:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:03:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:03:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:03:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:03:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:03:11 [DEBUG   ] Finished updating board flags in 1.759 seconds
2019-01-20 15:03:22 [DEBUG   ] Got command RPT from MCS: ref #1229004
2019-01-20 15:03:22 [DEBUG   ] summary = ERROR
2019-01-20 15:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229004  13 58503 54202405 A  ERRORERROR'
2019-01-20 15:03:22 [DEBUG   ] Got command RPT from MCS: ref #1229005
2019-01-20 15:03:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229005  77 58503 54202609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:03:22 [DEBUG   ] Got command RPT from MCS: ref #1229006
2019-01-20 15:03:22 [DEBUG   ] summary = ERROR
2019-01-20 15:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229006  13 58503 54202813 A  ERRORERROR'
2019-01-20 15:03:23 [DEBUG   ] Got command RPT from MCS: ref #1229007
2019-01-20 15:03:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229007  77 58503 54203017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:03:23 [DEBUG   ] Got command RPT from MCS: ref #1229008
2019-01-20 15:03:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 15:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229008  12 58503 54203209 A  ERRORB˜™š'
2019-01-20 15:03:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 15:03:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 15:04:07 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 15:04:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:04:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:04:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:04:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:04:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:04:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:04:11 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-20 15:04:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 15:04:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 15:05:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 15:05:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:05:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-20 15:05:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:05:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:05:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:05:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:05:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:05:11 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-01-20 15:05:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 15:05:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 15:06:06 [DEBUG   ] Got command RPT from MCS: ref #1229018
2019-01-20 15:06:06 [DEBUG   ] summary = ERROR
2019-01-20 15:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229018  13 58503 54366665 A  ERRORERROR'
2019-01-20 15:06:06 [DEBUG   ] Got command RPT from MCS: ref #1229019
2019-01-20 15:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229019  77 58503 54366666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:06:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 15:06:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:06:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 15:06:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:06:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:06:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:06:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:06:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:06:11 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-20 15:06:27 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 15:06:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 15:07:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 15:07:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 15:07:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:07:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:07:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:07:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:07:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:07:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:07:11 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-20 15:07:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 15:07:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 15:08:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 15:08:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:08:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 15:08:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:08:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:08:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:08:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:08:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:08:12 [DEBUG   ] Finished updating board flags in 2.222 seconds
2019-01-20 15:08:22 [DEBUG   ] Got command RPT from MCS: ref #1229046
2019-01-20 15:08:22 [DEBUG   ] summary = ERROR
2019-01-20 15:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229046  13 58503 54502501 A  ERRORERROR'
2019-01-20 15:08:22 [DEBUG   ] Got command RPT from MCS: ref #1229047
2019-01-20 15:08:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229047  77 58503 54502693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:08:22 [DEBUG   ] Got command RPT from MCS: ref #1229048
2019-01-20 15:08:22 [DEBUG   ] summary = ERROR
2019-01-20 15:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229048  13 58503 54502897 A  ERRORERROR'
2019-01-20 15:08:23 [DEBUG   ] Got command RPT from MCS: ref #1229050
2019-01-20 15:08:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229050  77 58503 54503101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:08:23 [DEBUG   ] Got command RPT from MCS: ref #1229051
2019-01-20 15:08:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 15:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229051  12 58503 54503293 A  ERRORB˜™š'
2019-01-20 15:08:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 15:08:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 15:09:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 15:09:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:09:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:09:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:09:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:09:11 [WARNING ] (13, 1, 'bot')
2019-01-20 15:09:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:09:11 [DEBUG   ] Finished updating board flags in 1.317 seconds
2019-01-20 15:09:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 15:09:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 15:10:08 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-20 15:10:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:10:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:10:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:10:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:10:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:10:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:10:12 [DEBUG   ] Finished updating board flags in 2.079 seconds
2019-01-20 15:10:27 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-20 15:10:48 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-20 15:11:06 [DEBUG   ] Got command RPT from MCS: ref #1229060
2019-01-20 15:11:06 [DEBUG   ] summary = ERROR
2019-01-20 15:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229060  13 58503 54666677 A  ERRORERROR'
2019-01-20 15:11:06 [DEBUG   ] Got command RPT from MCS: ref #1229061
2019-01-20 15:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229061  77 58503 54666678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:11:08 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-20 15:11:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:11:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:11:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:11:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:11:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:11:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:11:12 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-01-20 15:11:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 15:11:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 15:12:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 15:12:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:12:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:12:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:12:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:12:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:12:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:12:12 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-01-20 15:12:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 15:12:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 15:13:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 15:13:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:13:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 15:13:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:13:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:13:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:13:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:13:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:13:12 [DEBUG   ] Finished updating board flags in 1.998 seconds
2019-01-20 15:13:22 [DEBUG   ] Got command RPT from MCS: ref #1229077
2019-01-20 15:13:22 [DEBUG   ] summary = ERROR
2019-01-20 15:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229077  13 58503 54802585 A  ERRORERROR'
2019-01-20 15:13:22 [DEBUG   ] Got command RPT from MCS: ref #1229078
2019-01-20 15:13:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229078  77 58503 54802777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:13:22 [DEBUG   ] Got command RPT from MCS: ref #1229079
2019-01-20 15:13:22 [DEBUG   ] summary = ERROR
2019-01-20 15:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229079  13 58503 54802981 A  ERRORERROR'
2019-01-20 15:13:23 [DEBUG   ] Got command RPT from MCS: ref #1229080
2019-01-20 15:13:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229080  77 58503 54803185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:13:23 [DEBUG   ] Got command RPT from MCS: ref #1229081
2019-01-20 15:13:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 15:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229081  12 58503 54803389 A  ERRORB™™š'
2019-01-20 15:13:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 15:13:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 15:14:08 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 15:14:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 15:14:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:14:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:14:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:14:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:14:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:14:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:14:12 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-20 15:14:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 15:14:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 15:15:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 15:15:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:15:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:15:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:15:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:15:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:15:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:15:12 [DEBUG   ] Finished updating board flags in 1.776 seconds
2019-01-20 15:15:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-20 15:15:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 15:16:06 [DEBUG   ] Got command RPT from MCS: ref #1229086
2019-01-20 15:16:06 [DEBUG   ] summary = ERROR
2019-01-20 15:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229086  13 58503 54966677 A  ERRORERROR'
2019-01-20 15:16:06 [DEBUG   ] Got command RPT from MCS: ref #1229087
2019-01-20 15:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229087  77 58503 54966678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:16:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 15:16:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:16:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 15:16:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:16:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:16:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:16:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:16:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:16:12 [DEBUG   ] Finished updating board flags in 1.669 seconds
2019-01-20 15:16:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-20 15:16:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 15:17:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 15:17:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:17:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:17:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:17:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:17:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:17:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:17:12 [DEBUG   ] Finished updating board flags in 1.533 seconds
2019-01-20 15:17:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 15:17:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 15:18:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 15:18:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:18:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:18:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:18:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:18:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:18:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:18:12 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-20 15:18:22 [DEBUG   ] Got command RPT from MCS: ref #1229109
2019-01-20 15:18:22 [DEBUG   ] summary = ERROR
2019-01-20 15:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229109  13 58503 55102669 A  ERRORERROR'
2019-01-20 15:18:22 [DEBUG   ] Got command RPT from MCS: ref #1229110
2019-01-20 15:18:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229110  77 58503 55102873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:18:23 [DEBUG   ] Got command RPT from MCS: ref #1229111
2019-01-20 15:18:23 [DEBUG   ] summary = ERROR
2019-01-20 15:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229111  13 58503 55103065 A  ERRORERROR'
2019-01-20 15:18:23 [DEBUG   ] Got command RPT from MCS: ref #1229113
2019-01-20 15:18:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229113  77 58503 55103269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:18:23 [DEBUG   ] Got command RPT from MCS: ref #1229114
2019-01-20 15:18:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 15:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229114  12 58503 55103473 A  ERRORB˜™š'
2019-01-20 15:18:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 15:18:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 15:19:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 15:19:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 15:19:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:19:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:19:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:19:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:19:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:19:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:19:12 [DEBUG   ] Finished updating board flags in 1.400 seconds
2019-01-20 15:19:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 15:19:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 15:20:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 15:20:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:20:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:20:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:20:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:20:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:20:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:20:12 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-01-20 15:20:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 15:20:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 15:21:06 [DEBUG   ] Got command RPT from MCS: ref #1229123
2019-01-20 15:21:06 [DEBUG   ] summary = ERROR
2019-01-20 15:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229123  13 58503 55266677 A  ERRORERROR'
2019-01-20 15:21:06 [DEBUG   ] Got command RPT from MCS: ref #1229124
2019-01-20 15:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229124  77 58503 55266678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:21:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 15:21:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:21:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:21:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:21:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:21:12 [WARNING ] (13, 1, 'bot')
2019-01-20 15:21:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:21:12 [DEBUG   ] Finished updating board flags in 1.344 seconds
2019-01-20 15:21:30 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-20 15:21:50 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-20 15:22:10 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-20 15:22:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:22:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 15:22:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:22:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:22:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:22:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:22:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:22:13 [DEBUG   ] Finished updating board flags in 2.069 seconds
2019-01-20 15:22:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 15:22:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-20 15:23:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 15:23:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:23:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:23:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:23:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:23:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:23:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:23:13 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-20 15:23:22 [DEBUG   ] Got command RPT from MCS: ref #1229144
2019-01-20 15:23:22 [DEBUG   ] summary = ERROR
2019-01-20 15:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229144  13 58503 55402753 A  ERRORERROR'
2019-01-20 15:23:22 [DEBUG   ] Got command RPT from MCS: ref #1229145
2019-01-20 15:23:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229145  77 58503 55402957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:23:23 [DEBUG   ] Got command RPT from MCS: ref #1229146
2019-01-20 15:23:23 [DEBUG   ] summary = ERROR
2019-01-20 15:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229146  13 58503 55403149 A  ERRORERROR'
2019-01-20 15:23:23 [DEBUG   ] Got command RPT from MCS: ref #1229147
2019-01-20 15:23:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229147  77 58503 55403353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:23:23 [DEBUG   ] Got command RPT from MCS: ref #1229148
2019-01-20 15:23:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 15:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229148  12 58503 55403557 A  ERRORB˜™š'
2019-01-20 15:23:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 15:23:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 15:24:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-20 15:24:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:24:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:24:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:24:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:24:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:24:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:24:13 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-20 15:24:30 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-20 15:24:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 15:25:10 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 15:25:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 15:25:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:25:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 15:25:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:25:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:25:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:25:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:25:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:25:13 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-20 15:25:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 15:25:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 15:26:06 [DEBUG   ] Got command RPT from MCS: ref #1229153
2019-01-20 15:26:06 [DEBUG   ] summary = ERROR
2019-01-20 15:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229153  13 58503 55566673 A  ERRORERROR'
2019-01-20 15:26:06 [DEBUG   ] Got command RPT from MCS: ref #1229154
2019-01-20 15:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229154  77 58503 55566674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:26:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 15:26:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 15:26:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:26:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:26:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:26:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:26:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:26:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:26:13 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-20 15:26:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 15:26:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-20 15:27:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 15:27:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:27:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:27:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:27:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:27:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:27:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:27:13 [DEBUG   ] Finished updating board flags in 1.646 seconds
2019-01-20 15:27:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-20 15:27:51 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 15:28:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 15:28:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:28:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:28:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:28:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:28:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:28:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:28:13 [DEBUG   ] Finished updating board flags in 1.557 seconds
2019-01-20 15:28:22 [DEBUG   ] Got command RPT from MCS: ref #1229172
2019-01-20 15:28:22 [DEBUG   ] summary = ERROR
2019-01-20 15:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229172  13 58503 55702837 A  ERRORERROR'
2019-01-20 15:28:23 [DEBUG   ] Got command RPT from MCS: ref #1229173
2019-01-20 15:28:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229173  77 58503 55703041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:28:23 [DEBUG   ] Got command RPT from MCS: ref #1229174
2019-01-20 15:28:23 [DEBUG   ] summary = ERROR
2019-01-20 15:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229174  13 58503 55703245 A  ERRORERROR'
2019-01-20 15:28:23 [DEBUG   ] Got command RPT from MCS: ref #1229176
2019-01-20 15:28:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229176  77 58503 55703437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:28:23 [DEBUG   ] Got command RPT from MCS: ref #1229177
2019-01-20 15:28:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 15:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229177  12 58503 55703641 A  ERRORB˜™š'
2019-01-20 15:28:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 15:28:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 15:29:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 15:29:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:29:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 15:29:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:29:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:29:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:29:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:29:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:29:13 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-20 15:29:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 15:29:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 15:30:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 15:30:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:30:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:30:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:30:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:30:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:30:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:30:13 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-20 15:30:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 15:30:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 15:31:06 [DEBUG   ] Got command RPT from MCS: ref #1229186
2019-01-20 15:31:06 [DEBUG   ] summary = ERROR
2019-01-20 15:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229186  13 58503 55866677 A  ERRORERROR'
2019-01-20 15:31:06 [DEBUG   ] Got command RPT from MCS: ref #1229187
2019-01-20 15:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229187  77 58503 55866678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:31:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 15:31:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:31:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:31:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:31:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:31:13 [WARNING ] (13, 1, 'bot')
2019-01-20 15:31:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:31:13 [DEBUG   ] Finished updating board flags in 1.371 seconds
2019-01-20 15:31:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 15:31:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 15:32:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 15:32:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:32:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 15:32:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:32:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:32:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:32:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:32:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:32:14 [DEBUG   ] Finished updating board flags in 2.042 seconds
2019-01-20 15:32:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-20 15:32:51 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2019-01-20 15:33:12 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-20 15:33:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 15:33:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:33:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:33:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:33:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:33:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:33:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:33:14 [DEBUG   ] Finished updating board flags in 2.018 seconds
2019-01-20 15:33:22 [DEBUG   ] Got command RPT from MCS: ref #1229207
2019-01-20 15:33:22 [DEBUG   ] summary = ERROR
2019-01-20 15:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229207  13 58503 56002929 A  ERRORERROR'
2019-01-20 15:33:23 [DEBUG   ] Got command RPT from MCS: ref #1229208
2019-01-20 15:33:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229208  77 58503 56003121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:33:23 [DEBUG   ] Got command RPT from MCS: ref #1229209
2019-01-20 15:33:23 [DEBUG   ] summary = ERROR
2019-01-20 15:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229209  13 58503 56003325 A  ERRORERROR'
2019-01-20 15:33:23 [DEBUG   ] Got command RPT from MCS: ref #1229210
2019-01-20 15:33:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229210  77 58503 56003529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:33:23 [DEBUG   ] Got command RPT from MCS: ref #1229211
2019-01-20 15:33:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 15:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229211  12 58503 56003733 A  ERRORB˜™š'
2019-01-20 15:33:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 15:33:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-20 15:34:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 15:34:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:34:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:34:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:34:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:34:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:34:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:34:14 [DEBUG   ] Finished updating board flags in 1.980 seconds
2019-01-20 15:34:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 15:34:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 15:35:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-20 15:35:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:35:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 15:35:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:35:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:35:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:35:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:35:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:35:14 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-01-20 15:35:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 15:35:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 15:36:06 [DEBUG   ] Got command RPT from MCS: ref #1229216
2019-01-20 15:36:06 [DEBUG   ] summary = ERROR
2019-01-20 15:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229216  13 58503 56166681 A  ERRORERROR'
2019-01-20 15:36:06 [DEBUG   ] Got command RPT from MCS: ref #1229217
2019-01-20 15:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229217  77 58503 56166682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:36:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 15:36:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:36:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:36:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:36:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:36:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:36:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:36:14 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-20 15:36:32 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 15:36:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 15:37:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 15:37:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:37:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:37:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:37:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:37:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:37:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:37:14 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-20 15:37:32 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 15:37:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-20 15:38:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 15:38:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 15:38:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:38:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:38:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:38:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:38:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:38:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:38:14 [DEBUG   ] Finished updating board flags in 1.634 seconds
2019-01-20 15:38:23 [DEBUG   ] Got command RPT from MCS: ref #1229239
2019-01-20 15:38:23 [DEBUG   ] summary = ERROR
2019-01-20 15:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229239  13 58503 56303013 A  ERRORERROR'
2019-01-20 15:38:23 [DEBUG   ] Got command RPT from MCS: ref #1229240
2019-01-20 15:38:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229240  77 58503 56303217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:38:23 [DEBUG   ] Got command RPT from MCS: ref #1229241
2019-01-20 15:38:23 [DEBUG   ] summary = ERROR
2019-01-20 15:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229241  13 58503 56303409 A  ERRORERROR'
2019-01-20 15:38:23 [DEBUG   ] Got command RPT from MCS: ref #1229243
2019-01-20 15:38:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229243  77 58503 56303613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:38:23 [DEBUG   ] Got command RPT from MCS: ref #1229244
2019-01-20 15:38:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 15:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229244  12 58503 56303817 A  ERRORB˜™š'
2019-01-20 15:38:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 15:38:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 15:39:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 15:39:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 15:39:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:39:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:39:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:39:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:39:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:39:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:39:14 [DEBUG   ] Finished updating board flags in 1.649 seconds
2019-01-20 15:39:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 15:39:53 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-20 15:40:13 [DEBUG   ] Finished updating ant stats in 1.257 seconds
2019-01-20 15:40:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:40:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:40:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:40:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:40:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:40:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:40:14 [DEBUG   ] Finished updating board flags in 1.513 seconds
2019-01-20 15:40:33 [DEBUG   ] Finished updating ant stats in 1.152 seconds
2019-01-20 15:40:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 15:41:06 [DEBUG   ] Got command RPT from MCS: ref #1229253
2019-01-20 15:41:06 [DEBUG   ] summary = ERROR
2019-01-20 15:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229253  13 58503 56466685 A  ERRORERROR'
2019-01-20 15:41:06 [DEBUG   ] Got command RPT from MCS: ref #1229254
2019-01-20 15:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229254  77 58503 56466686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:41:13 [DEBUG   ] Finished updating ant stats in 1.054 seconds
2019-01-20 15:41:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 15:41:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:41:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:41:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:41:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:41:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:41:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:41:14 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-20 15:41:33 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2019-01-20 15:41:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 15:42:13 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2019-01-20 15:42:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 15:42:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:42:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:42:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:42:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:42:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:42:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:42:14 [DEBUG   ] Finished updating board flags in 1.400 seconds
2019-01-20 15:42:33 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2019-01-20 15:42:53 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-20 15:43:13 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2019-01-20 15:43:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:43:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:43:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:43:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:43:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:43:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:43:14 [DEBUG   ] Finished updating board flags in 1.395 seconds
2019-01-20 15:43:23 [DEBUG   ] Got command RPT from MCS: ref #1229270
2019-01-20 15:43:23 [DEBUG   ] summary = ERROR
2019-01-20 15:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229270  13 58503 56603097 A  ERRORERROR'
2019-01-20 15:43:23 [DEBUG   ] Got command RPT from MCS: ref #1229271
2019-01-20 15:43:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229271  77 58503 56603301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:43:23 [DEBUG   ] Got command RPT from MCS: ref #1229272
2019-01-20 15:43:23 [DEBUG   ] summary = ERROR
2019-01-20 15:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229272  13 58503 56603505 A  ERRORERROR'
2019-01-20 15:43:23 [DEBUG   ] Got command RPT from MCS: ref #1229273
2019-01-20 15:43:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229273  77 58503 56603697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:43:23 [DEBUG   ] Got command RPT from MCS: ref #1229274
2019-01-20 15:43:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 15:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229274  12 58503 56603901 A  ERRORB˜™š'
2019-01-20 15:43:34 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2019-01-20 15:43:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-20 15:44:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:44:14 [DEBUG   ] Finished updating ant stats in 1.242 seconds
2019-01-20 15:44:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:44:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:44:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:44:14 [WARNING ] (13, 1, 'bot')
2019-01-20 15:44:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:44:14 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-20 15:44:34 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2019-01-20 15:44:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 15:45:14 [DEBUG   ] Finished updating ant stats in 1.032 seconds
2019-01-20 15:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:45:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:45:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:45:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:45:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:45:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:45:15 [DEBUG   ] Finished updating board flags in 2.197 seconds
2019-01-20 15:45:34 [DEBUG   ] Finished updating ant stats in 0.950 seconds
2019-01-20 15:45:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 15:46:06 [DEBUG   ] Got command RPT from MCS: ref #1229279
2019-01-20 15:46:06 [DEBUG   ] summary = ERROR
2019-01-20 15:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229279  13 58503 56766685 A  ERRORERROR'
2019-01-20 15:46:06 [DEBUG   ] Got command RPT from MCS: ref #1229280
2019-01-20 15:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229280  77 58503 56766686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:46:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 15:46:14 [DEBUG   ] Finished updating ant stats in 0.851 seconds
2019-01-20 15:46:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:46:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 15:46:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:46:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:46:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:46:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:46:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:46:15 [DEBUG   ] Finished updating board flags in 1.982 seconds
2019-01-20 15:46:34 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2019-01-20 15:46:54 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 15:47:14 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2019-01-20 15:47:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:47:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:47:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:47:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:47:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:47:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:47:15 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-20 15:47:35 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2019-01-20 15:47:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 15:48:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:48:15 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2019-01-20 15:48:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:48:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:48:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:48:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:48:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:48:15 [DEBUG   ] Finished updating board flags in 1.843 seconds
2019-01-20 15:48:23 [DEBUG   ] Got command RPT from MCS: ref #1229302
2019-01-20 15:48:23 [DEBUG   ] summary = ERROR
2019-01-20 15:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229302  13 58503 56903185 A  ERRORERROR'
2019-01-20 15:48:23 [DEBUG   ] Got command RPT from MCS: ref #1229303
2019-01-20 15:48:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229303  77 58503 56903377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:48:23 [DEBUG   ] Got command RPT from MCS: ref #1229304
2019-01-20 15:48:23 [DEBUG   ] summary = ERROR
2019-01-20 15:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229304  13 58503 56903581 A  ERRORERROR'
2019-01-20 15:48:23 [DEBUG   ] Got command RPT from MCS: ref #1229306
2019-01-20 15:48:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229306  77 58503 56903785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:48:23 [DEBUG   ] Got command RPT from MCS: ref #1229308
2019-01-20 15:48:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 15:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229308  12 58503 56903989 A  ERRORB˜™š'
2019-01-20 15:48:35 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2019-01-20 15:48:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 15:49:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:49:15 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2019-01-20 15:49:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:49:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:49:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:49:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:49:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:49:15 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-01-20 15:49:35 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2019-01-20 15:49:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 15:50:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:50:15 [DEBUG   ] Finished updating ant stats in 0.639 seconds
2019-01-20 15:50:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-20 15:50:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:50:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:50:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:50:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:50:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:50:15 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-01-20 15:50:35 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2019-01-20 15:50:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-20 15:51:06 [DEBUG   ] Got command RPT from MCS: ref #1229316
2019-01-20 15:51:06 [DEBUG   ] summary = ERROR
2019-01-20 15:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229316  13 58503 57066681 A  ERRORERROR'
2019-01-20 15:51:06 [DEBUG   ] Got command RPT from MCS: ref #1229317
2019-01-20 15:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229317  77 58503 57066682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:51:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 15:51:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:51:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 15:51:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:51:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:51:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:51:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:51:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:51:15 [DEBUG   ] Finished updating board flags in 1.626 seconds
2019-01-20 15:51:16 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-20 15:51:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 15:51:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 15:52:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:52:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:52:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:52:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:52:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:52:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:52:15 [DEBUG   ] Finished updating board flags in 1.629 seconds
2019-01-20 15:52:16 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 15:52:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 15:52:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 15:53:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 15:53:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:53:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 15:53:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:53:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:53:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:53:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:53:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:53:15 [DEBUG   ] Finished updating board flags in 1.536 seconds
2019-01-20 15:53:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 15:53:23 [DEBUG   ] Got command RPT from MCS: ref #1229337
2019-01-20 15:53:23 [DEBUG   ] summary = ERROR
2019-01-20 15:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229337  13 58503 57203273 A  ERRORERROR'
2019-01-20 15:53:23 [DEBUG   ] Got command RPT from MCS: ref #1229338
2019-01-20 15:53:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229338  77 58503 57203465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:53:23 [DEBUG   ] Got command RPT from MCS: ref #1229339
2019-01-20 15:53:23 [DEBUG   ] summary = ERROR
2019-01-20 15:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229339  13 58503 57203669 A  ERRORERROR'
2019-01-20 15:53:23 [DEBUG   ] Got command RPT from MCS: ref #1229340
2019-01-20 15:53:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229340  77 58503 57203873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:53:24 [DEBUG   ] Got command RPT from MCS: ref #1229341
2019-01-20 15:53:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 15:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229341  12 58503 57204065 A  ERRORB—™š'
2019-01-20 15:53:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 15:53:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 15:54:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:54:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:54:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:54:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:54:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:54:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:54:15 [DEBUG   ] Finished updating board flags in 1.468 seconds
2019-01-20 15:54:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 15:54:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 15:54:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 15:55:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:55:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:55:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:55:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:55:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:55:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:55:15 [DEBUG   ] Finished updating board flags in 1.454 seconds
2019-01-20 15:55:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 15:55:37 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2019-01-20 15:55:57 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-20 15:56:06 [DEBUG   ] Got command RPT from MCS: ref #1229346
2019-01-20 15:56:06 [DEBUG   ] summary = ERROR
2019-01-20 15:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229346  13 58503 57366681 A  ERRORERROR'
2019-01-20 15:56:06 [DEBUG   ] Got command RPT from MCS: ref #1229347
2019-01-20 15:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229347  77 58503 57366682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:56:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:56:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:56:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:56:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:56:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:56:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:56:15 [DEBUG   ] Finished updating board flags in 1.443 seconds
2019-01-20 15:56:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 15:56:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 15:56:57 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 15:57:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:57:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:57:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:57:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:57:15 [WARNING ] (13, 1, 'bot')
2019-01-20 15:57:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:57:15 [DEBUG   ] Finished updating board flags in 1.435 seconds
2019-01-20 15:57:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 15:57:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 15:57:57 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 15:58:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:58:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 15:58:16 [WARNING ] (13, 1, 'bot')
2019-01-20 15:58:16 [WARNING ] (13, 1, 'bot')
2019-01-20 15:58:16 [WARNING ] (13, 1, 'bot')
2019-01-20 15:58:16 [WARNING ] (13, 1, 'bot')
2019-01-20 15:58:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:58:16 [DEBUG   ] Finished updating board flags in 2.224 seconds
2019-01-20 15:58:17 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 15:58:23 [DEBUG   ] Got command RPT from MCS: ref #1229365
2019-01-20 15:58:23 [DEBUG   ] summary = ERROR
2019-01-20 15:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229365  13 58503 57503357 A  ERRORERROR'
2019-01-20 15:58:23 [DEBUG   ] Got command RPT from MCS: ref #1229366
2019-01-20 15:58:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229366  77 58503 57503549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:58:23 [DEBUG   ] Got command RPT from MCS: ref #1229367
2019-01-20 15:58:23 [DEBUG   ] summary = ERROR
2019-01-20 15:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229367  13 58503 57503753 A  ERRORERROR'
2019-01-20 15:58:23 [DEBUG   ] Got command RPT from MCS: ref #1229369
2019-01-20 15:58:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 15:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229369  77 58503 57503957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 15:58:24 [DEBUG   ] Got command RPT from MCS: ref #1229371
2019-01-20 15:58:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 15:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229371  12 58503 57504161 A  ERRORB˜™š'
2019-01-20 15:58:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-20 15:58:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 15:59:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 15:59:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 15:59:16 [WARNING ] (13, 1, 'bot')
2019-01-20 15:59:16 [WARNING ] (13, 1, 'bot')
2019-01-20 15:59:16 [WARNING ] (13, 1, 'bot')
2019-01-20 15:59:16 [WARNING ] (13, 1, 'bot')
2019-01-20 15:59:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 15:59:16 [DEBUG   ] Finished updating board flags in 2.191 seconds
2019-01-20 15:59:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 15:59:37 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 15:59:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 16:00:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:00:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:00:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:00:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:00:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:00:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:00:16 [DEBUG   ] Finished updating board flags in 1.982 seconds
2019-01-20 16:00:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 16:00:38 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-20 16:00:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 16:01:06 [DEBUG   ] Got command RPT from MCS: ref #1229379
2019-01-20 16:01:06 [DEBUG   ] summary = ERROR
2019-01-20 16:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229379  13 58503 57666689 A  ERRORERROR'
2019-01-20 16:01:06 [DEBUG   ] Got command RPT from MCS: ref #1229380
2019-01-20 16:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229380  77 58503 57666690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:01:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:01:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 16:01:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:01:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:01:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:01:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:01:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:01:16 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-20 16:01:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 16:01:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 16:01:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 16:02:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:02:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 16:02:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:02:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:02:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:02:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:02:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:02:16 [DEBUG   ] Finished updating board flags in 1.773 seconds
2019-01-20 16:02:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-20 16:02:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 16:02:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 16:03:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:03:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:03:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:03:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:03:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:03:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:03:16 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-20 16:03:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:03:23 [DEBUG   ] Got command RPT from MCS: ref #1229400
2019-01-20 16:03:23 [DEBUG   ] summary = ERROR
2019-01-20 16:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229400  13 58503 57803441 A  ERRORERROR'
2019-01-20 16:03:23 [DEBUG   ] Got command RPT from MCS: ref #1229401
2019-01-20 16:03:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229401  77 58503 57803645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:03:23 [DEBUG   ] Got command RPT from MCS: ref #1229402
2019-01-20 16:03:23 [DEBUG   ] summary = ERROR
2019-01-20 16:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229402  13 58503 57803849 A  ERRORERROR'
2019-01-20 16:03:24 [DEBUG   ] Got command RPT from MCS: ref #1229403
2019-01-20 16:03:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229403  77 58503 57804041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:03:24 [DEBUG   ] Got command RPT from MCS: ref #1229404
2019-01-20 16:03:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 16:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229404  12 58503 57804245 A  ERRORB˜™š'
2019-01-20 16:03:38 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 16:03:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 16:04:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:04:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 16:04:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 16:04:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:04:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:04:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:04:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:04:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:04:16 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-20 16:04:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 16:04:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-20 16:04:59 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-20 16:05:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:05:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:05:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:05:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:05:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:05:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:05:16 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-20 16:05:19 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-20 16:05:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 16:05:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 16:06:06 [DEBUG   ] Got command RPT from MCS: ref #1229409
2019-01-20 16:06:06 [DEBUG   ] summary = ERROR
2019-01-20 16:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229409  13 58503 57966685 A  ERRORERROR'
2019-01-20 16:06:06 [DEBUG   ] Got command RPT from MCS: ref #1229410
2019-01-20 16:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229410  77 58503 57966686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:06:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:06:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:06:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:06:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:06:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:06:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:06:16 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-20 16:06:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 16:06:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 16:06:59 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 16:07:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:07:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:07:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:07:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:07:16 [WARNING ] (13, 1, 'bot')
2019-01-20 16:07:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:07:16 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-20 16:07:19 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-20 16:07:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:07:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:08:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:08:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:08:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:08:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:08:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:08:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:08:17 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-01-20 16:08:19 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 16:08:23 [DEBUG   ] Got command RPT from MCS: ref #1229432
2019-01-20 16:08:23 [DEBUG   ] summary = ERROR
2019-01-20 16:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229432  13 58503 58103529 A  ERRORERROR'
2019-01-20 16:08:23 [DEBUG   ] Got command RPT from MCS: ref #1229433
2019-01-20 16:08:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229433  77 58503 58103733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:08:23 [DEBUG   ] Got command RPT from MCS: ref #1229434
2019-01-20 16:08:23 [DEBUG   ] summary = ERROR
2019-01-20 16:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229434  13 58503 58103925 A  ERRORERROR'
2019-01-20 16:08:24 [DEBUG   ] Got command RPT from MCS: ref #1229436
2019-01-20 16:08:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229436  77 58503 58104129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:08:24 [DEBUG   ] Got command RPT from MCS: ref #1229437
2019-01-20 16:08:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 16:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229437  12 58503 58104333 A  ERRORB˜™š'
2019-01-20 16:08:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 16:08:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 16:09:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 16:09:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:09:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 16:09:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:09:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:09:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:09:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:09:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:09:17 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-20 16:09:19 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-20 16:09:40 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-20 16:10:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 16:10:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:10:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:10:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:10:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:10:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:10:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:10:17 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-20 16:10:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 16:10:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-20 16:11:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 16:11:06 [DEBUG   ] Got command RPT from MCS: ref #1229446
2019-01-20 16:11:06 [DEBUG   ] summary = ERROR
2019-01-20 16:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229446  13 58503 58266689 A  ERRORERROR'
2019-01-20 16:11:06 [DEBUG   ] Got command RPT from MCS: ref #1229447
2019-01-20 16:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229447  77 58503 58266690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:11:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:11:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 16:11:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:11:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:11:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:11:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:11:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:11:17 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-20 16:11:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 16:11:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 16:12:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-20 16:12:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:12:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:12:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:12:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:12:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:12:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:12:17 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-20 16:12:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 16:12:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 16:13:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 16:13:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:13:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 16:13:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:13:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:13:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:13:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:13:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:13:17 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-01-20 16:13:20 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 16:13:23 [DEBUG   ] Got command RPT from MCS: ref #1229463
2019-01-20 16:13:23 [DEBUG   ] summary = ERROR
2019-01-20 16:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229463  13 58503 58403617 A  ERRORERROR'
2019-01-20 16:13:23 [DEBUG   ] Got command RPT from MCS: ref #1229464
2019-01-20 16:13:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229464  77 58503 58403809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:13:24 [DEBUG   ] Got command RPT from MCS: ref #1229465
2019-01-20 16:13:24 [DEBUG   ] summary = ERROR
2019-01-20 16:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229465  13 58503 58404013 A  ERRORERROR'
2019-01-20 16:13:24 [DEBUG   ] Got command RPT from MCS: ref #1229466
2019-01-20 16:13:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229466  77 58503 58404217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:13:24 [DEBUG   ] Got command RPT from MCS: ref #1229467
2019-01-20 16:13:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 16:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229467  12 58503 58404421 A  ERRORB˜™š'
2019-01-20 16:13:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 16:14:01 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-20 16:14:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:14:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 16:14:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 16:14:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:14:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:14:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:14:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:14:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:14:17 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-01-20 16:14:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 16:14:41 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 16:15:01 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-20 16:15:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:15:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:15:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:15:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:15:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:15:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:15:17 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-20 16:15:21 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 16:15:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-20 16:16:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 16:16:06 [DEBUG   ] Got command RPT from MCS: ref #1229472
2019-01-20 16:16:06 [DEBUG   ] summary = ERROR
2019-01-20 16:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229472  13 58503 58566689 A  ERRORERROR'
2019-01-20 16:16:06 [DEBUG   ] Got command RPT from MCS: ref #1229473
2019-01-20 16:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229473  77 58503 58566690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:16:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:16:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:16:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:16:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:16:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:16:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:16:17 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-20 16:16:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 16:16:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:17:01 [DEBUG   ] Finished updating ant stats in 0.876 seconds
2019-01-20 16:17:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:17:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:17:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:17:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:17:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:17:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:17:17 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-20 16:17:21 [DEBUG   ] Finished updating ant stats in 0.728 seconds
2019-01-20 16:17:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 16:18:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 16:18:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:18:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 16:18:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:18:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:18:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:18:17 [WARNING ] (13, 1, 'bot')
2019-01-20 16:18:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:18:17 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-01-20 16:18:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-20 16:18:23 [DEBUG   ] Got command RPT from MCS: ref #1229495
2019-01-20 16:18:23 [DEBUG   ] summary = ERROR
2019-01-20 16:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229495  13 58503 58703697 A  ERRORERROR'
2019-01-20 16:18:23 [DEBUG   ] Got command RPT from MCS: ref #1229496
2019-01-20 16:18:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229496  77 58503 58703901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:18:24 [DEBUG   ] Got command RPT from MCS: ref #1229497
2019-01-20 16:18:24 [DEBUG   ] summary = ERROR
2019-01-20 16:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229497  13 58503 58704105 A  ERRORERROR'
2019-01-20 16:18:24 [DEBUG   ] Got command RPT from MCS: ref #1229499
2019-01-20 16:18:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229499  77 58503 58704297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:18:24 [DEBUG   ] Got command RPT from MCS: ref #1229500
2019-01-20 16:18:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 16:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229500  12 58503 58704501 A  ERRORB˜™š'
2019-01-20 16:18:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 16:19:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 16:19:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:19:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:19:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:19:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:19:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:19:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:19:18 [DEBUG   ] Finished updating board flags in 2.070 seconds
2019-01-20 16:19:21 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 16:19:41 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-20 16:20:02 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-20 16:20:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:20:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:20:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:20:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:20:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:20:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:20:18 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-20 16:20:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 16:20:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-20 16:21:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 16:21:06 [DEBUG   ] Got command RPT from MCS: ref #1229509
2019-01-20 16:21:06 [DEBUG   ] summary = ERROR
2019-01-20 16:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229509  13 58503 58866693 A  ERRORERROR'
2019-01-20 16:21:06 [DEBUG   ] Got command RPT from MCS: ref #1229510
2019-01-20 16:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229510  77 58503 58866694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:21:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:21:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 16:21:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:21:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:21:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:21:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:21:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:21:18 [DEBUG   ] Finished updating board flags in 1.958 seconds
2019-01-20 16:21:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 16:21:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 16:22:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 16:22:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:22:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:22:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:22:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:22:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:22:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:22:18 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-20 16:22:22 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-20 16:22:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:23:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 16:23:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:23:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:23:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:23:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:23:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:23:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:23:18 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-20 16:23:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-20 16:23:23 [DEBUG   ] Got command RPT from MCS: ref #1229530
2019-01-20 16:23:23 [DEBUG   ] summary = ERROR
2019-01-20 16:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229530  13 58503 59003777 A  ERRORERROR'
2019-01-20 16:23:23 [DEBUG   ] Got command RPT from MCS: ref #1229531
2019-01-20 16:23:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229531  77 58503 59003981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:23:24 [DEBUG   ] Got command RPT from MCS: ref #1229532
2019-01-20 16:23:24 [DEBUG   ] summary = ERROR
2019-01-20 16:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229532  13 58503 59004185 A  ERRORERROR'
2019-01-20 16:23:24 [DEBUG   ] Got command RPT from MCS: ref #1229533
2019-01-20 16:23:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229533  77 58503 59004389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:23:24 [DEBUG   ] Got command RPT from MCS: ref #1229534
2019-01-20 16:23:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 16:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229534  12 58503 59004581 A  ERRORB˜™š'
2019-01-20 16:23:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 16:24:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 16:24:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 16:24:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:24:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:24:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:24:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:24:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:24:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:24:18 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-01-20 16:24:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 16:24:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 16:25:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 16:25:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:25:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 16:25:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:25:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:25:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:25:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:25:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:25:18 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-20 16:25:23 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-20 16:25:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 16:26:00 [DEBUG   ] Got command RPT from MCS: ref #1229539
2019-01-20 16:26:00 [DEBUG   ] summary = ERROR
2019-01-20 16:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229539  13 58503 59160509 A  ERRORERROR'
2019-01-20 16:26:00 [DEBUG   ] Got command RPT from MCS: ref #1229540
2019-01-20 16:26:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229540  77 58503 59160510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:26:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 16:26:05 [DEBUG   ] Got command INI from MCS: ref #1229541
2019-01-20 16:26:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-01-20 16:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI  1229541   8 58503 59165518 ABOOTING'
2019-01-20 16:26:06 [DEBUG   ] Got command RPT from MCS: ref #1229542
2019-01-20 16:26:06 [DEBUG   ] summary = BOOTING
2019-01-20 16:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229542  15 58503 59166685 ABOOTINGBOOTING'
2019-01-20 16:26:06 [DEBUG   ] Got command RPT from MCS: ref #1229543
2019-01-20 16:26:06 [DEBUG   ] info = Running INI sequence
2019-01-20 16:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229543  28 58503 59166686 ABOOTINGRunning INI sequence'
2019-01-20 16:26:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 16:26:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 16:26:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:26:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:26:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:26:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:26:18 [WARNING ] (13, 1, 'bot')
2019-01-20 16:26:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:26:18 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-20 16:26:29 [INFO    ] -------------------
2019-01-20 16:26:29 [INFO    ]  LWA board status
2019-01-20 16:26:29 [INFO    ] -------------------
2019-01-20 16:26:29 [INFO    ] DP 1: 2 lwa27
2019-01-20 16:26:29 [INFO    ] DP 1: 3 lwa24
2019-01-20 16:26:29 [INFO    ] DP 1: 4 lwa23
2019-01-20 16:26:29 [INFO    ] DP 1: 5 lwa18
2019-01-20 16:26:29 [INFO    ] DP 1: 6 lwa10
2019-01-20 16:26:29 [INFO    ] DP 1: 7 lwa32
2019-01-20 16:26:29 [INFO    ] DP 1: 8 lwa11
2019-01-20 16:26:29 [INFO    ] DP 1: 9 lwa30
2019-01-20 16:26:29 [INFO    ] DP 1: 10 lwa12
2019-01-20 16:26:29 [INFO    ] DP 1: 11 lwa8
2019-01-20 16:26:29 [INFO    ] DP 1: 12 lwa13
2019-01-20 16:26:29 [INFO    ] DP 1: 13 lwa26
2019-01-20 16:26:29 [INFO    ] DP 1: 14 lwa14
2019-01-20 16:26:29 [INFO    ] DP 1: 16 lwa22
2019-01-20 16:26:29 [INFO    ] DP 1: 17 lwa20
2019-01-20 16:26:29 [INFO    ] DP 1: 18 lwa1
2019-01-20 16:26:29 [INFO    ] DP 1: 19 lwa5
2019-01-20 16:26:29 [INFO    ] DP 1: 20 lwa25
2019-01-20 16:26:29 [INFO    ] DP 1: 21 lwa35
2019-01-20 16:26:29 [INFO    ] DP 1: 22 lwa19
2019-01-20 16:26:29 [INFO    ] DP 1: 23 lwa21
2019-01-20 16:26:29 [INFO    ] DP 1: 24 lwa6
2019-01-20 16:26:29 [INFO    ] DP 1: 25 lwa7
2019-01-20 16:26:29 [INFO    ] DP 1: 26 lwa33
2019-01-20 16:26:29 [INFO    ] DP 1: 27 lwa15
2019-01-20 16:26:29 [INFO    ] DP 1: 28 lwa28
2019-01-20 16:26:29 [INFO    ] DP 2: 1 lwa16
2019-01-20 16:26:29 [INFO    ] DP 2: 15 lwa34
2019-01-20 16:26:29 [INFO    ] Total of 28 boards
2019-01-20 16:26:29 [INFO    ] Total of 260 stands
2019-01-20 16:26:29 [INFO    ] -------------------
2019-01-20 16:26:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1554
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1555
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1556
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1557
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1558
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1559
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1560
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1561
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1562
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1563
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1564
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1565
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1566
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1567
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1568
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1569
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1570
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1571
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1572
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1573
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1574
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1575
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1576
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1577
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1578
2019-01-20 16:26:36 [DEBUG   ] 2019-01-20 16:26:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1579
2019-01-20 16:26:48 [DEBUG   ] 2019-01-20 16:26:48 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1554 exited with status 0
2019-01-20 16:26:48 [DEBUG   ] 2019-01-20 16:26:48 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1555 exited with status 0
2019-01-20 16:26:48 [DEBUG   ] 2019-01-20 16:26:48 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1556 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1557 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1558 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1559 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1560 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1561 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1562 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1563 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1564 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1565 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1566 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1567 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1568 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1569 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1570 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1571 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1572 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1573 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1574 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1575 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1576 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1577 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1578 exited with status 0
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1579 exited with status 0
2019-01-20 16:26:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] spawn_process: at 2019-01-20 16:26:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1606
2019-01-20 16:26:49 [DEBUG   ] 2019-01-20 16:26:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1607
2019-01-20 16:26:54 [DEBUG   ] 2019-01-20 16:26:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1606 exited with status 0
2019-01-20 16:26:54 [DEBUG   ] 2019-01-20 16:26:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1607 exited with status 0
2019-01-20 16:26:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-01-20 16:26:54 [DEBUG   ] spawn_process: at 2019-01-20 16:26:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-01-20 16:26:54 [DEBUG   ] spawn_process: at 2019-01-20 16:26:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-01-20 16:26:54 [INFO    ] Setting Beam 1 xbars
2019-01-20 16:26:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-01-20 16:26:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-01-20 16:26:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-01-20 16:26:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-01-20 16:26:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-01-20 16:26:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-01-20 16:26:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-01-20 16:26:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-01-20 16:26:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-01-20 16:26:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-01-20 16:26:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-01-20 16:26:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-01-20 16:26:55 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-01-20 16:26:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-01-20 16:26:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-01-20 16:26:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-01-20 16:26:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-01-20 16:26:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-01-20 16:26:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-01-20 16:26:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-01-20 16:26:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-01-20 16:26:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-01-20 16:26:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-01-20 16:26:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-01-20 16:26:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-01-20 16:26:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-01-20 16:26:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-01-20 16:26:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-01-20 16:26:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-01-20 16:26:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-01-20 16:26:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-01-20 16:26:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-01-20 16:26:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-01-20 16:26:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-01-20 16:26:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-01-20 16:26:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-01-20 16:26:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-01-20 16:26:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-01-20 16:26:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-01-20 16:26:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-01-20 16:26:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-01-20 16:26:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-01-20 16:26:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-01-20 16:26:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-01-20 16:26:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-01-20 16:26:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-01-20 16:26:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-01-20 16:26:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-01-20 16:26:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-01-20 16:26:59 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-01-20 16:27:00 [INFO    ] Setting Beam 2 xbars
2019-01-20 16:27:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-01-20 16:27:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-01-20 16:27:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-01-20 16:27:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-01-20 16:27:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-01-20 16:27:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-01-20 16:27:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-01-20 16:27:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-01-20 16:27:00 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-01-20 16:27:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-01-20 16:27:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-01-20 16:27:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-01-20 16:27:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-01-20 16:27:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-01-20 16:27:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-01-20 16:27:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-01-20 16:27:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-01-20 16:27:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-01-20 16:27:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-01-20 16:27:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-01-20 16:27:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-01-20 16:27:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-01-20 16:27:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-01-20 16:27:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-01-20 16:27:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-01-20 16:27:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-01-20 16:27:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-01-20 16:27:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-01-20 16:27:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-01-20 16:27:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-01-20 16:27:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-01-20 16:27:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-01-20 16:27:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-01-20 16:27:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-01-20 16:27:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-01-20 16:27:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-01-20 16:27:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-01-20 16:27:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-01-20 16:27:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-01-20 16:27:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-01-20 16:27:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-01-20 16:27:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-01-20 16:27:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-01-20 16:27:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-01-20 16:27:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-01-20 16:27:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-01-20 16:27:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-01-20 16:27:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-01-20 16:27:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-01-20 16:27:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-01-20 16:27:05 [INFO    ] Setting Beam 3 xbars
2019-01-20 16:27:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-01-20 16:27:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-01-20 16:27:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-01-20 16:27:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-01-20 16:27:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-01-20 16:27:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-01-20 16:27:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-01-20 16:27:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-01-20 16:27:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-01-20 16:27:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-01-20 16:27:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-01-20 16:27:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-01-20 16:27:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-01-20 16:27:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-01-20 16:27:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-01-20 16:27:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-01-20 16:27:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-01-20 16:27:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-01-20 16:27:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-01-20 16:27:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-01-20 16:27:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-01-20 16:27:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-01-20 16:27:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-01-20 16:27:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-01-20 16:27:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-01-20 16:27:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-01-20 16:27:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-01-20 16:27:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-01-20 16:27:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-01-20 16:27:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-01-20 16:27:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-01-20 16:27:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-01-20 16:27:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-01-20 16:27:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-01-20 16:27:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-01-20 16:27:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-01-20 16:27:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-01-20 16:27:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-01-20 16:27:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-01-20 16:27:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-01-20 16:27:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-01-20 16:27:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-01-20 16:27:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-01-20 16:27:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-01-20 16:27:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-01-20 16:27:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-01-20 16:27:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-01-20 16:27:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-01-20 16:27:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-01-20 16:27:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-01-20 16:27:11 [INFO    ] Setting Beam 4 xbars
2019-01-20 16:27:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-01-20 16:27:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-20 16:27:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-20 16:27:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-20 16:27:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-20 16:27:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-01-20 16:27:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-01-20 16:27:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-01-20 16:27:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-01-20 16:27:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-01-20 16:27:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-01-20 16:27:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-01-20 16:27:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-01-20 16:27:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-01-20 16:27:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-01-20 16:27:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-01-20 16:27:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-01-20 16:27:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-01-20 16:27:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-01-20 16:27:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-01-20 16:27:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-01-20 16:27:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-01-20 16:27:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-01-20 16:27:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-01-20 16:27:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-01-20 16:27:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-01-20 16:27:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-01-20 16:27:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-01-20 16:27:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-01-20 16:27:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-01-20 16:27:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-01-20 16:27:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-01-20 16:27:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-01-20 16:27:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-01-20 16:27:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-01-20 16:27:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-01-20 16:27:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-01-20 16:27:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-01-20 16:27:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-01-20 16:27:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-01-20 16:27:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-01-20 16:27:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-01-20 16:27:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-01-20 16:27:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-01-20 16:27:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-01-20 16:27:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-01-20 16:27:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-01-20 16:27:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-01-20 16:27:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-01-20 16:27:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-01-20 16:27:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-01-20 16:27:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-01-20 16:27:16 [INFO    ] All xbars set
2019-01-20 16:27:16 [INFO    ] Setting adder chain routing for all beams
2019-01-20 16:27:21 [INFO    ] Setting beam ids
2019-01-20 16:27:31 [INFO    ] Starting beam delay calibration
2019-01-20 16:27:43 [INFO    ] Beam 1 latency is 5739
2019-01-20 16:27:43 [INFO    ] Beam 2 latency is 5746
2019-01-20 16:27:43 [INFO    ] Beam 3 latency is 5732
2019-01-20 16:27:43 [INFO    ] Beam 4 latency is 5733
2019-01-20 16:27:43 [INFO    ] Stop calibration
2019-01-20 16:27:51 [INFO    ] Beam delay calibration successful
2019-01-20 16:27:51 [INFO    ] Calibration passed
2019-01-20 16:27:51 [DEBUG   ] spawn_process: at 2019-01-20 16:27:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-01-20 16:27:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-01-20 16:27:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-01-20 16:27:51 [DEBUG   ] spawn_process: at 2019-01-20 16:27:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-01-20 16:27:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-01-20 16:27:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-01-20 16:27:51 [DEBUG   ] spawn_process: at 2019-01-20 16:27:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-01-20 16:27:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-01-20 16:27:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-01-20 16:27:51 [DEBUG   ] spawn_process: at 2019-01-20 16:27:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-01-20 16:27:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-01-20 16:27:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-01-20 16:27:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2019-01-20 16:27:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 266 ms (1548001672.269 s) with PID 3289 and time 1548001673
2019-01-20 16:27:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2019-01-20 16:27:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 352 ms (1548001672.355 s) with PID 3292 and time 1548001673
2019-01-20 16:27:53 [DEBUG   ] Finished updating ant stats in 0.894 seconds
2019-01-20 16:27:53 [INFO    ] Started antennas statistics background thread
2019-01-20 16:27:53 [INFO    ] Started board flags background thread
2019-01-20 16:27:53 [INFO    ] Started BAM background thread
2019-01-20 16:27:53 [INFO    ] Finished the INI process (ref. #1229541) in 107.960 s
2019-01-20 16:27:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:27:54 [WARNING ] (13, 1, 'bot')
2019-01-20 16:27:54 [WARNING ] (13, 1, 'bot')
2019-01-20 16:27:54 [WARNING ] (13, 1, 'bot')
2019-01-20 16:27:54 [WARNING ] (13, 1, 'bot')
2019-01-20 16:27:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2019-01-20 16:27:54 [DEBUG   ] Finished updating board flags in 1.075 seconds
2019-01-20 16:28:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 16:28:23 [DEBUG   ] Got command RPT from MCS: ref #1229561
2019-01-20 16:28:23 [DEBUG   ] summary = ERROR
2019-01-20 16:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229561  13 58503 59303865 A  ERRORERROR'
2019-01-20 16:28:24 [DEBUG   ] Got command RPT from MCS: ref #1229562
2019-01-20 16:28:24 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229562  98 58503 59304069 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:28:24 [DEBUG   ] Got command RPT from MCS: ref #1229563
2019-01-20 16:28:24 [DEBUG   ] summary = ERROR
2019-01-20 16:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229563  13 58503 59304273 A  ERRORERROR'
2019-01-20 16:28:24 [DEBUG   ] Got command RPT from MCS: ref #1229565
2019-01-20 16:28:24 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229565  98 58503 59304477 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:28:24 [DEBUG   ] Got command RPT from MCS: ref #1229566
2019-01-20 16:28:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 16:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229566  12 58503 59304669 A  ERRORB˜™š'
2019-01-20 16:28:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 16:28:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 16:28:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:28:54 [WARNING ] (13, 1, 'bot')
2019-01-20 16:28:54 [WARNING ] (13, 1, 'bot')
2019-01-20 16:28:54 [WARNING ] (13, 1, 'bot')
2019-01-20 16:28:54 [WARNING ] (13, 1, 'bot')
2019-01-20 16:28:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2019-01-20 16:28:54 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-20 16:29:05 [DEBUG   ] Got command RPT from MCS: ref #1229575
2019-01-20 16:29:05 [DEBUG   ] summary = ERROR
2019-01-20 16:29:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229575  13 58503 59345521 A  ERRORERROR'
2019-01-20 16:29:05 [DEBUG   ] Got command RPT from MCS: ref #1229576
2019-01-20 16:29:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:29:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229576  98 58503 59345522 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:29:10 [DEBUG   ] Got command INI from MCS: ref #1229577
2019-01-20 16:29:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-01-20 16:29:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI  1229577   8 58503 59350529 ABOOTING'
2019-01-20 16:29:13 [DEBUG   ] Finished updating ant stats in 0.611 seconds
2019-01-20 16:29:31 [INFO    ] -------------------
2019-01-20 16:29:31 [INFO    ]  LWA board status
2019-01-20 16:29:31 [INFO    ] -------------------
2019-01-20 16:29:31 [INFO    ] DP 1: 2 lwa27
2019-01-20 16:29:31 [INFO    ] DP 1: 3 lwa24
2019-01-20 16:29:31 [INFO    ] DP 1: 4 lwa23
2019-01-20 16:29:31 [INFO    ] DP 1: 5 lwa18
2019-01-20 16:29:31 [INFO    ] DP 1: 6 lwa10
2019-01-20 16:29:31 [INFO    ] DP 1: 7 lwa32
2019-01-20 16:29:31 [INFO    ] DP 1: 8 lwa11
2019-01-20 16:29:31 [INFO    ] DP 1: 9 lwa30
2019-01-20 16:29:31 [INFO    ] DP 1: 10 lwa12
2019-01-20 16:29:31 [INFO    ] DP 1: 11 lwa8
2019-01-20 16:29:31 [INFO    ] DP 1: 12 lwa13
2019-01-20 16:29:31 [INFO    ] DP 1: 13 lwa26
2019-01-20 16:29:31 [INFO    ] DP 1: 14 lwa14
2019-01-20 16:29:31 [INFO    ] DP 1: 16 lwa22
2019-01-20 16:29:31 [INFO    ] DP 1: 17 lwa20
2019-01-20 16:29:31 [INFO    ] DP 1: 18 lwa1
2019-01-20 16:29:31 [INFO    ] DP 1: 19 lwa5
2019-01-20 16:29:31 [INFO    ] DP 1: 20 lwa25
2019-01-20 16:29:31 [INFO    ] DP 1: 21 lwa35
2019-01-20 16:29:31 [INFO    ] DP 1: 22 lwa19
2019-01-20 16:29:31 [INFO    ] DP 1: 23 lwa21
2019-01-20 16:29:31 [INFO    ] DP 1: 24 lwa6
2019-01-20 16:29:31 [INFO    ] DP 1: 25 lwa7
2019-01-20 16:29:31 [INFO    ] DP 1: 26 lwa33
2019-01-20 16:29:31 [INFO    ] DP 1: 27 lwa15
2019-01-20 16:29:31 [INFO    ] DP 1: 28 lwa28
2019-01-20 16:29:31 [INFO    ] DP 2: 1 lwa16
2019-01-20 16:29:31 [INFO    ] DP 2: 15 lwa34
2019-01-20 16:29:31 [INFO    ] Total of 28 boards
2019-01-20 16:29:31 [INFO    ] Total of 260 stands
2019-01-20 16:29:31 [INFO    ] -------------------
2019-01-20 16:29:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3838
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3839
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3840
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3841
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3842
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3843
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3844
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3845
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3846
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3847
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3848
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3849
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3850
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3851
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3852
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3853
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3854
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3855
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3856
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3857
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3858
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3859
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3860
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3861
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3862
2019-01-20 16:29:38 [DEBUG   ] 2019-01-20 16:29:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3863
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3838 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3839 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3840 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3841 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3842 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3843 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3844 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3845 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3846 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3847 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3848 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3849 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3850 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3851 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3852 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3853 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3854 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3855 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3856 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3857 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3858 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3859 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3860 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3861 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3862 exited with status 0
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3863 exited with status 0
2019-01-20 16:29:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] spawn_process: at 2019-01-20 16:29:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3890
2019-01-20 16:29:50 [DEBUG   ] 2019-01-20 16:29:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3891
2019-01-20 16:29:56 [DEBUG   ] 2019-01-20 16:29:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3890 exited with status 0
2019-01-20 16:29:56 [DEBUG   ] 2019-01-20 16:29:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3891 exited with status 0
2019-01-20 16:29:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-01-20 16:29:56 [DEBUG   ] spawn_process: at 2019-01-20 16:29:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-01-20 16:29:56 [DEBUG   ] spawn_process: at 2019-01-20 16:29:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-01-20 16:29:56 [INFO    ] Setting Beam 1 xbars
2019-01-20 16:29:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-01-20 16:29:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-01-20 16:29:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-01-20 16:29:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-01-20 16:29:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-01-20 16:29:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-01-20 16:29:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-01-20 16:29:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-01-20 16:29:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-01-20 16:29:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-01-20 16:29:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-01-20 16:29:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-01-20 16:29:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-01-20 16:29:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-01-20 16:29:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-01-20 16:29:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-01-20 16:29:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-01-20 16:29:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-01-20 16:29:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-01-20 16:29:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-01-20 16:29:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-01-20 16:29:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-01-20 16:29:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-01-20 16:29:59 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-01-20 16:29:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-01-20 16:29:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-01-20 16:29:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-01-20 16:29:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-01-20 16:29:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-01-20 16:29:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-01-20 16:29:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-01-20 16:29:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-01-20 16:30:00 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-01-20 16:30:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-01-20 16:30:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-01-20 16:30:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-01-20 16:30:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-01-20 16:30:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-01-20 16:30:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-01-20 16:30:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-01-20 16:30:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-01-20 16:30:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-01-20 16:30:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-01-20 16:30:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-01-20 16:30:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-01-20 16:30:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-01-20 16:30:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-01-20 16:30:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-01-20 16:30:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-01-20 16:30:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-01-20 16:30:01 [INFO    ] Setting Beam 2 xbars
2019-01-20 16:30:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-01-20 16:30:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-01-20 16:30:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-01-20 16:30:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-01-20 16:30:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-01-20 16:30:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-01-20 16:30:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-01-20 16:30:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-01-20 16:30:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-01-20 16:30:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-01-20 16:30:03 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-01-20 16:30:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-01-20 16:30:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-01-20 16:30:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-01-20 16:30:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-01-20 16:30:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-01-20 16:30:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-01-20 16:30:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-01-20 16:30:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-01-20 16:30:04 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-01-20 16:30:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-01-20 16:30:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-01-20 16:30:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-01-20 16:30:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-01-20 16:30:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-01-20 16:30:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-01-20 16:30:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-01-20 16:30:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-01-20 16:30:05 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-01-20 16:30:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-01-20 16:30:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-01-20 16:30:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-01-20 16:30:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-01-20 16:30:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-01-20 16:30:06 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-01-20 16:30:06 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-01-20 16:30:06 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-01-20 16:30:06 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-01-20 16:30:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-01-20 16:30:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-01-20 16:30:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-01-20 16:30:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-01-20 16:30:07 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-01-20 16:30:07 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-01-20 16:30:07 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-01-20 16:30:07 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-01-20 16:30:07 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-01-20 16:30:07 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-01-20 16:30:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-01-20 16:30:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-01-20 16:30:07 [INFO    ] Setting Beam 3 xbars
2019-01-20 16:30:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-01-20 16:30:08 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-01-20 16:30:08 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-01-20 16:30:08 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-01-20 16:30:08 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-01-20 16:30:08 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-01-20 16:30:08 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-01-20 16:30:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-01-20 16:30:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-01-20 16:30:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-01-20 16:30:09 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-01-20 16:30:09 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-01-20 16:30:09 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-01-20 16:30:09 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-01-20 16:30:09 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-01-20 16:30:09 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-01-20 16:30:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-01-20 16:30:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-01-20 16:30:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-01-20 16:30:10 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-01-20 16:30:10 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-01-20 16:30:10 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-01-20 16:30:10 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-01-20 16:30:10 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-01-20 16:30:10 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-01-20 16:30:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-01-20 16:30:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-01-20 16:30:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-01-20 16:30:11 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-01-20 16:30:11 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-01-20 16:30:11 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-01-20 16:30:11 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-01-20 16:30:11 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-01-20 16:30:11 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-01-20 16:30:11 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-01-20 16:30:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-01-20 16:30:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-01-20 16:30:12 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-01-20 16:30:12 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-01-20 16:30:12 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-01-20 16:30:12 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-01-20 16:30:12 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-01-20 16:30:12 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-01-20 16:30:12 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-01-20 16:30:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-01-20 16:30:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-01-20 16:30:13 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-01-20 16:30:13 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-01-20 16:30:13 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-01-20 16:30:13 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-01-20 16:30:13 [INFO    ] Setting Beam 4 xbars
2019-01-20 16:30:13 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-01-20 16:30:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-20 16:30:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-20 16:30:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-20 16:30:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-20 16:30:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-01-20 16:30:14 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-01-20 16:30:14 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-01-20 16:30:14 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-01-20 16:30:14 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-01-20 16:30:14 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-01-20 16:30:14 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-01-20 16:30:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-01-20 16:30:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-01-20 16:30:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-01-20 16:30:15 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-01-20 16:30:15 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-01-20 16:30:15 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-01-20 16:30:15 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-01-20 16:30:15 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-01-20 16:30:15 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-01-20 16:30:15 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-01-20 16:30:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-01-20 16:30:16 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-01-20 16:30:16 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-01-20 16:30:16 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-01-20 16:30:16 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-01-20 16:30:16 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-01-20 16:30:16 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-01-20 16:30:16 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-01-20 16:30:16 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-01-20 16:30:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-01-20 16:30:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-01-20 16:30:17 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-01-20 16:30:17 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-01-20 16:30:17 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-01-20 16:30:17 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-01-20 16:30:17 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-01-20 16:30:17 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-01-20 16:30:17 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-01-20 16:30:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-01-20 16:30:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-01-20 16:30:18 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-01-20 16:30:18 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-01-20 16:30:18 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-01-20 16:30:18 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-01-20 16:30:18 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-01-20 16:30:18 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-01-20 16:30:18 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-01-20 16:30:18 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-01-20 16:30:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-01-20 16:30:19 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-01-20 16:30:19 [INFO    ] All xbars set
2019-01-20 16:30:19 [INFO    ] Setting adder chain routing for all beams
2019-01-20 16:30:23 [INFO    ] Setting beam ids
2019-01-20 16:30:33 [INFO    ] Starting beam delay calibration
2019-01-20 16:30:45 [INFO    ] Beam 1 latency is 5718
2019-01-20 16:30:45 [INFO    ] Beam 2 latency is 5730
2019-01-20 16:30:45 [INFO    ] Beam 3 latency is 5730
2019-01-20 16:30:45 [INFO    ] Beam 4 latency is 5734
2019-01-20 16:30:45 [INFO    ] Stop calibration
2019-01-20 16:30:53 [INFO    ] Beam delay calibration successful
2019-01-20 16:30:53 [INFO    ] Calibration passed
2019-01-20 16:30:53 [DEBUG   ] spawn_process: at 2019-01-20 16:30:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-01-20 16:30:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-01-20 16:30:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-01-20 16:30:54 [DEBUG   ] spawn_process: at 2019-01-20 16:30:54 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-01-20 16:30:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-01-20 16:30:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-01-20 16:30:54 [DEBUG   ] spawn_process: at 2019-01-20 16:30:54 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-01-20 16:30:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-01-20 16:30:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-01-20 16:30:54 [DEBUG   ] spawn_process: at 2019-01-20 16:30:54 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-01-20 16:30:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-01-20 16:30:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-01-20 16:30:54 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2019-01-20 16:30:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 335 ms (1548001854.338 s) with PID 5474 and time 1548001855
2019-01-20 16:30:54 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2019-01-20 16:30:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 426 ms (1548001854.429 s) with PID 5477 and time 1548001855
2019-01-20 16:30:55 [DEBUG   ] Finished updating ant stats in 0.820 seconds
2019-01-20 16:30:55 [INFO    ] Started antennas statistics background thread
2019-01-20 16:30:55 [INFO    ] Started board flags background thread
2019-01-20 16:30:55 [INFO    ] Started BAM background thread
2019-01-20 16:30:55 [INFO    ] Finished the INI process (ref. #1229577) in 105.021 s
2019-01-20 16:30:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:30:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:30:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:30:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:30:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:30:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:30:56 [DEBUG   ] Finished updating board flags in 1.004 seconds
2019-01-20 16:31:06 [DEBUG   ] Got command RPT from MCS: ref #1229578
2019-01-20 16:31:06 [DEBUG   ] summary = ERROR
2019-01-20 16:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229578  13 58503 59466689 A  ERRORERROR'
2019-01-20 16:31:06 [DEBUG   ] Got command RPT from MCS: ref #1229579
2019-01-20 16:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229579  77 58503 59466690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:31:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:31:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:31:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 16:31:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:31:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:31:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:31:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:31:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:31:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:31:56 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-20 16:32:10 [DEBUG   ] Got command RPT from MCS: ref #1229599
2019-01-20 16:32:10 [DEBUG   ] summary = ERROR
2019-01-20 16:32:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229599  13 58503 59530525 A  ERRORERROR'
2019-01-20 16:32:10 [DEBUG   ] Got command RPT from MCS: ref #1229600
2019-01-20 16:32:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:32:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229600  77 58503 59530526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:32:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 16:32:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 16:32:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 16:32:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 16:32:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:32:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:32:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:32:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:32:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:32:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:32:56 [DEBUG   ] Finished updating board flags in 0.988 seconds
2019-01-20 16:33:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 16:33:23 [DEBUG   ] Got command RPT from MCS: ref #1229601
2019-01-20 16:33:23 [DEBUG   ] summary = ERROR
2019-01-20 16:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229601  13 58503 59603957 A  ERRORERROR'
2019-01-20 16:33:24 [DEBUG   ] Got command RPT from MCS: ref #1229602
2019-01-20 16:33:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229602  77 58503 59604149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:33:24 [DEBUG   ] Got command RPT from MCS: ref #1229603
2019-01-20 16:33:24 [DEBUG   ] summary = ERROR
2019-01-20 16:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229603  13 58503 59604353 A  ERRORERROR'
2019-01-20 16:33:24 [DEBUG   ] Got command RPT from MCS: ref #1229604
2019-01-20 16:33:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229604  77 58503 59604557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:33:24 [DEBUG   ] Got command RPT from MCS: ref #1229605
2019-01-20 16:33:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 16:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229605  12 58503 59604749 A  ERRORB—™š'
2019-01-20 16:33:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 16:33:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 16:33:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:33:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:33:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:33:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:33:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:33:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:33:57 [DEBUG   ] Finished updating board flags in 1.834 seconds
2019-01-20 16:34:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 16:34:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 16:34:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 16:34:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:34:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 16:34:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:34:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:34:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:34:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:34:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:34:56 [DEBUG   ] Finished updating board flags in 1.284 seconds
2019-01-20 16:35:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 16:35:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 16:35:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 16:35:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:35:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 16:35:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:35:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:35:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:35:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:35:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:35:56 [DEBUG   ] Finished updating board flags in 1.166 seconds
2019-01-20 16:36:06 [DEBUG   ] Got command RPT from MCS: ref #1229610
2019-01-20 16:36:06 [DEBUG   ] summary = ERROR
2019-01-20 16:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229610  13 58503 59766689 A  ERRORERROR'
2019-01-20 16:36:06 [DEBUG   ] Got command RPT from MCS: ref #1229611
2019-01-20 16:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229611  77 58503 59766690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:36:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 16:36:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 16:36:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 16:36:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:36:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 16:36:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:36:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:36:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:36:56 [WARNING ] (13, 1, 'bot')
2019-01-20 16:36:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:36:56 [DEBUG   ] Finished updating board flags in 0.958 seconds
2019-01-20 16:37:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 16:37:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 16:37:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-20 16:37:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 16:37:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:37:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:37:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:37:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:37:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:37:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:37:57 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-01-20 16:38:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 16:38:24 [DEBUG   ] Got command RPT from MCS: ref #1229633
2019-01-20 16:38:24 [DEBUG   ] summary = ERROR
2019-01-20 16:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229633  13 58503 59904037 A  ERRORERROR'
2019-01-20 16:38:24 [DEBUG   ] Got command RPT from MCS: ref #1229634
2019-01-20 16:38:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229634  77 58503 59904241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:38:24 [DEBUG   ] Got command RPT from MCS: ref #1229635
2019-01-20 16:38:24 [DEBUG   ] summary = ERROR
2019-01-20 16:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229635  13 58503 59904445 A  ERRORERROR'
2019-01-20 16:38:24 [DEBUG   ] Got command RPT from MCS: ref #1229637
2019-01-20 16:38:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229637  77 58503 59904637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:38:24 [DEBUG   ] Got command RPT from MCS: ref #1229638
2019-01-20 16:38:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 16:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229638  12 58503 59904841 A  ERRORB˜™š'
2019-01-20 16:38:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 16:38:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 16:38:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 16:38:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:38:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:38:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:38:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:38:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:38:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:38:57 [DEBUG   ] Finished updating board flags in 1.181 seconds
2019-01-20 16:39:15 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-20 16:39:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 16:39:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 16:39:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 16:39:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:39:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:39:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:39:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:39:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:39:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:39:57 [DEBUG   ] Finished updating board flags in 1.012 seconds
2019-01-20 16:40:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 16:40:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 16:40:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 16:40:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 16:40:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:40:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 16:40:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:40:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:40:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:40:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:40:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:40:57 [DEBUG   ] Finished updating board flags in 1.058 seconds
2019-01-20 16:41:06 [DEBUG   ] Got command RPT from MCS: ref #1229647
2019-01-20 16:41:06 [DEBUG   ] summary = ERROR
2019-01-20 16:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229647  13 58503 60066689 A  ERRORERROR'
2019-01-20 16:41:06 [DEBUG   ] Got command RPT from MCS: ref #1229648
2019-01-20 16:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229648  77 58503 60066690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:41:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 16:41:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 16:41:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 16:41:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:41:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:41:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:41:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:41:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:41:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:41:58 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-01-20 16:42:16 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2019-01-20 16:42:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 16:42:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 16:42:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:42:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:42:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:42:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:42:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:42:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:42:57 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-01-20 16:43:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 16:43:24 [DEBUG   ] Got command RPT from MCS: ref #1229664
2019-01-20 16:43:24 [DEBUG   ] summary = ERROR
2019-01-20 16:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229664  13 58503 60204125 A  ERRORERROR'
2019-01-20 16:43:24 [DEBUG   ] Got command RPT from MCS: ref #1229665
2019-01-20 16:43:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229665  77 58503 60204329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:43:24 [DEBUG   ] Got command RPT from MCS: ref #1229666
2019-01-20 16:43:24 [DEBUG   ] summary = ERROR
2019-01-20 16:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229666  13 58503 60204521 A  ERRORERROR'
2019-01-20 16:43:24 [DEBUG   ] Got command RPT from MCS: ref #1229667
2019-01-20 16:43:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229667  77 58503 60204725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:43:24 [DEBUG   ] Got command RPT from MCS: ref #1229668
2019-01-20 16:43:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 16:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229668  12 58503 60204929 A  ERRORB˜™š'
2019-01-20 16:43:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 16:43:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 16:43:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:43:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 16:43:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:43:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:43:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:43:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:43:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:43:57 [DEBUG   ] Finished updating board flags in 1.229 seconds
2019-01-20 16:44:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 16:44:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 16:44:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 16:44:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:44:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:44:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:44:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:44:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:44:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:44:57 [DEBUG   ] Finished updating board flags in 1.185 seconds
2019-01-20 16:45:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 16:45:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:45:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:45:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:45:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:45:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:45:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:45:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:45:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:45:57 [DEBUG   ] Finished updating board flags in 1.021 seconds
2019-01-20 16:46:06 [DEBUG   ] Got command RPT from MCS: ref #1229673
2019-01-20 16:46:06 [DEBUG   ] summary = ERROR
2019-01-20 16:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229673  13 58503 60366693 A  ERRORERROR'
2019-01-20 16:46:06 [DEBUG   ] Got command RPT from MCS: ref #1229674
2019-01-20 16:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229674  77 58503 60366694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:46:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:46:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:46:37 [DEBUG   ] Got command DRX from MCS: ref #1229698
2019-01-20 16:46:37 [INFO    ] sending drx command to lwa34
2019-01-20 16:46:37 [DEBUG   ] run_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 0']
2019-01-20 16:46:37 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-20 16:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1229698   8 58503 60397013 A  ERROR'
2019-01-20 16:46:37 [DEBUG   ] Got command DRX from MCS: ref #1229699
2019-01-20 16:46:37 [INFO    ] sending drx command to lwa16
2019-01-20 16:46:37 [DEBUG   ] run_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 0']
2019-01-20 16:46:37 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-20 16:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1229699   8 58503 60397017 A  ERROR'
2019-01-20 16:46:37 [DEBUG   ] Got command DRX from MCS: ref #1229700
2019-01-20 16:46:37 [INFO    ] sending drx command to lwa34
2019-01-20 16:46:37 [DEBUG   ] run_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 0']
2019-01-20 16:46:37 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-20 16:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1229700   8 58503 60397021 A  ERROR'
2019-01-20 16:46:37 [DEBUG   ] Got command DRX from MCS: ref #1229701
2019-01-20 16:46:37 [INFO    ] sending drx command to lwa16
2019-01-20 16:46:37 [DEBUG   ] run_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 0']
2019-01-20 16:46:37 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-20 16:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1229701   8 58503 60397025 A  ERROR'
2019-01-20 16:46:37 [DEBUG   ] Got command BAM from MCS: ref #1229703
2019-01-20 16:46:37 [INFO    ] Finished processing BAM request
2019-01-20 16:46:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229703   8 58503 60397029 A  ERROR'
2019-01-20 16:46:37 [DEBUG   ] Got command BAM from MCS: ref #1229702
2019-01-20 16:46:37 [INFO    ] Finished processing BAM request
2019-01-20 16:46:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229702   8 58503 60397033 A  ERROR'
2019-01-20 16:46:37 [INFO    ] Finished starting DRX
2019-01-20 16:46:37 [INFO    ] Finished starting DRX
2019-01-20 16:46:37 [INFO    ] Finished starting DRX
2019-01-20 16:46:37 [INFO    ] Finished starting DRX
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 16:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 16:46:37 [DEBUG   ] spawn_process: at 2019-01-20 16:46:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 16:46:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:46:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 16:46:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:46:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 16:46:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:46:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:46:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:46:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:46:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:46:57 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-20 16:47:11 [DEBUG   ] Got command BAM from MCS: ref #1229707
2019-01-20 16:47:11 [INFO    ] Finished processing BAM request
2019-01-20 16:47:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:47:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229707   8 58503 60431029 A  ERROR'
2019-01-20 16:47:11 [DEBUG   ] Got command BAM from MCS: ref #1229706
2019-01-20 16:47:11 [INFO    ] Finished processing BAM request
2019-01-20 16:47:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:47:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229706   8 58503 60431033 A  ERROR'
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 16:47:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 16:47:11 [DEBUG   ] spawn_process: at 2019-01-20 16:47:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 16:47:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:47:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:47:45 [DEBUG   ] Got command BAM from MCS: ref #1229708
2019-01-20 16:47:45 [INFO    ] Finished processing BAM request
2019-01-20 16:47:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:47:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229708   8 58503 60465029 A  ERROR'
2019-01-20 16:47:45 [DEBUG   ] Got command BAM from MCS: ref #1229709
2019-01-20 16:47:45 [INFO    ] Finished processing BAM request
2019-01-20 16:47:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:47:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229709   8 58503 60465033 A  ERROR'
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 16:47:45 [DEBUG   ] spawn_process: at 2019-01-20 16:47:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 16:47:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:47:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:47:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:47:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:47:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:47:57 [WARNING ] (13, 1, 'bot')
2019-01-20 16:47:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:47:57 [DEBUG   ] Finished updating board flags in 0.969 seconds
2019-01-20 16:48:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:48:19 [DEBUG   ] Got command BAM from MCS: ref #1229712
2019-01-20 16:48:19 [INFO    ] Finished processing BAM request
2019-01-20 16:48:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229712   8 58503 60499029 A  ERROR'
2019-01-20 16:48:19 [DEBUG   ] Got command BAM from MCS: ref #1229713
2019-01-20 16:48:19 [INFO    ] Finished processing BAM request
2019-01-20 16:48:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229713   8 58503 60499033 A  ERROR'
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 16:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 16:48:19 [DEBUG   ] spawn_process: at 2019-01-20 16:48:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 16:48:24 [DEBUG   ] Got command RPT from MCS: ref #1229714
2019-01-20 16:48:24 [DEBUG   ] summary = ERROR
2019-01-20 16:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229714  13 58503 60504205 A  ERRORERROR'
2019-01-20 16:48:24 [DEBUG   ] Got command RPT from MCS: ref #1229715
2019-01-20 16:48:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229715  77 58503 60504409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:48:24 [DEBUG   ] Got command RPT from MCS: ref #1229716
2019-01-20 16:48:24 [DEBUG   ] summary = ERROR
2019-01-20 16:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229716  13 58503 60504613 A  ERRORERROR'
2019-01-20 16:48:24 [DEBUG   ] Got command RPT from MCS: ref #1229718
2019-01-20 16:48:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229718  77 58503 60504805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:48:25 [DEBUG   ] Got command RPT from MCS: ref #1229719
2019-01-20 16:48:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 16:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229719  12 58503 60505009 A  ERRORB�ff'
2019-01-20 16:48:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:48:53 [DEBUG   ] Got command BAM from MCS: ref #1229724
2019-01-20 16:48:53 [INFO    ] Finished processing BAM request
2019-01-20 16:48:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:48:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229724   8 58503 60533025 A  ERROR'
2019-01-20 16:48:53 [DEBUG   ] Got command BAM from MCS: ref #1229725
2019-01-20 16:48:53 [INFO    ] Finished processing BAM request
2019-01-20 16:48:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:48:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229725   8 58503 60533029 A  ERROR'
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 16:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 16:48:53 [DEBUG   ] spawn_process: at 2019-01-20 16:48:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 16:48:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:48:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-20 16:48:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 16:48:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:48:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 16:48:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:48:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:48:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:48:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:48:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:48:58 [DEBUG   ] Finished updating board flags in 1.368 seconds
2019-01-20 16:49:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:49:27 [DEBUG   ] Got command BAM from MCS: ref #1229726
2019-01-20 16:49:27 [INFO    ] Finished processing BAM request
2019-01-20 16:49:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:49:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229726   8 58503 60567025 A  ERROR'
2019-01-20 16:49:27 [DEBUG   ] Got command BAM from MCS: ref #1229727
2019-01-20 16:49:27 [INFO    ] Finished processing BAM request
2019-01-20 16:49:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:49:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229727   8 58503 60567029 A  ERROR'
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 16:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 16:49:27 [DEBUG   ] spawn_process: at 2019-01-20 16:49:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 16:49:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:49:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:49:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 16:49:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:49:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-20 16:49:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-01-20 16:49:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:49:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:49:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:49:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:49:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:49:58 [DEBUG   ] Finished updating board flags in 1.183 seconds
2019-01-20 16:50:01 [DEBUG   ] Got command BAM from MCS: ref #1229733
2019-01-20 16:50:01 [INFO    ] Finished processing BAM request
2019-01-20 16:50:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229733   8 58503 60601029 A  ERROR'
2019-01-20 16:50:01 [DEBUG   ] Got command BAM from MCS: ref #1229732
2019-01-20 16:50:01 [INFO    ] Finished processing BAM request
2019-01-20 16:50:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229732   8 58503 60601033 A  ERROR'
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 16:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 16:50:01 [DEBUG   ] spawn_process: at 2019-01-20 16:50:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 16:50:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:50:34 [DEBUG   ] Got command BAM from MCS: ref #1229735
2019-01-20 16:50:34 [INFO    ] Finished processing BAM request
2019-01-20 16:50:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:50:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229735   8 58503 60634033 A  ERROR'
2019-01-20 16:50:34 [DEBUG   ] Got command BAM from MCS: ref #1229734
2019-01-20 16:50:34 [INFO    ] Finished processing BAM request
2019-01-20 16:50:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:50:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229734   8 58503 60634037 A  ERROR'
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 16:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 16:50:34 [DEBUG   ] spawn_process: at 2019-01-20 16:50:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 16:50:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:50:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:50:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:50:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 16:50:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-20 16:50:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:50:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:50:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:50:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:50:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:50:58 [DEBUG   ] Finished updating board flags in 1.072 seconds
2019-01-20 16:51:06 [DEBUG   ] Got command RPT from MCS: ref #1229738
2019-01-20 16:51:06 [DEBUG   ] summary = ERROR
2019-01-20 16:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229738  13 58503 60666697 A  ERRORERROR'
2019-01-20 16:51:06 [DEBUG   ] Got command RPT from MCS: ref #1229739
2019-01-20 16:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229739  77 58503 60666698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:51:07 [DEBUG   ] Got command BAM from MCS: ref #1229737
2019-01-20 16:51:07 [INFO    ] Finished processing BAM request
2019-01-20 16:51:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229737   8 58503 60667025 A  ERROR'
2019-01-20 16:51:07 [DEBUG   ] Got command BAM from MCS: ref #1229736
2019-01-20 16:51:07 [INFO    ] Finished processing BAM request
2019-01-20 16:51:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229736   8 58503 60667029 A  ERROR'
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 16:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 16:51:07 [DEBUG   ] spawn_process: at 2019-01-20 16:51:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 16:51:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:51:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:51:40 [DEBUG   ] Got command BAM from MCS: ref #1229756
2019-01-20 16:51:40 [INFO    ] Finished processing BAM request
2019-01-20 16:51:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229756   8 58503 60700029 A  ERROR'
2019-01-20 16:51:40 [DEBUG   ] Got command BAM from MCS: ref #1229755
2019-01-20 16:51:40 [INFO    ] Finished processing BAM request
2019-01-20 16:51:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229755   8 58503 60700033 A  ERROR'
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 16:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 16:51:41 [DEBUG   ] spawn_process: at 2019-01-20 16:51:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 16:51:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:51:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 16:51:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:51:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 16:51:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-20 16:51:59 [WARNING ] (13, 1, 'bot')
2019-01-20 16:51:59 [WARNING ] (13, 1, 'bot')
2019-01-20 16:51:59 [WARNING ] (13, 1, 'bot')
2019-01-20 16:51:59 [WARNING ] (13, 1, 'bot')
2019-01-20 16:51:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:51:59 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-20 16:52:13 [DEBUG   ] Got command BAM from MCS: ref #1229757
2019-01-20 16:52:13 [INFO    ] Finished processing BAM request
2019-01-20 16:52:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:52:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229757   8 58503 60733029 A  ERROR'
2019-01-20 16:52:13 [DEBUG   ] Got command BAM from MCS: ref #1229758
2019-01-20 16:52:13 [INFO    ] Finished processing BAM request
2019-01-20 16:52:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:52:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229758   8 58503 60733033 A  ERROR'
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 16:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 16:52:13 [DEBUG   ] spawn_process: at 2019-01-20 16:52:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 16:52:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:52:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:52:46 [DEBUG   ] Got command BAM from MCS: ref #1229764
2019-01-20 16:52:46 [INFO    ] Finished processing BAM request
2019-01-20 16:52:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:52:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229764   8 58503 60766025 A  ERROR'
2019-01-20 16:52:46 [DEBUG   ] Got command BAM from MCS: ref #1229763
2019-01-20 16:52:46 [INFO    ] Finished processing BAM request
2019-01-20 16:52:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:52:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229763   8 58503 60766029 A  ERROR'
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 16:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 16:52:46 [DEBUG   ] spawn_process: at 2019-01-20 16:52:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 16:52:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:52:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:52:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 16:52:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:52:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:52:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:52:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:52:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:52:58 [DEBUG   ] Finished updating board flags in 1.369 seconds
2019-01-20 16:53:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:53:19 [DEBUG   ] Got command BAM from MCS: ref #1229766
2019-01-20 16:53:19 [INFO    ] Finished processing BAM request
2019-01-20 16:53:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229766   8 58503 60799033 A  ERROR'
2019-01-20 16:53:19 [DEBUG   ] Got command BAM from MCS: ref #1229765
2019-01-20 16:53:19 [INFO    ] Finished processing BAM request
2019-01-20 16:53:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229765   8 58503 60799037 A  ERROR'
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 16:53:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 16:53:19 [DEBUG   ] spawn_process: at 2019-01-20 16:53:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 16:53:24 [DEBUG   ] Got command RPT from MCS: ref #1229767
2019-01-20 16:53:24 [DEBUG   ] summary = ERROR
2019-01-20 16:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229767  13 58503 60804293 A  ERRORERROR'
2019-01-20 16:53:24 [DEBUG   ] Got command RPT from MCS: ref #1229768
2019-01-20 16:53:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229768  77 58503 60804497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:53:24 [DEBUG   ] Got command RPT from MCS: ref #1229769
2019-01-20 16:53:24 [DEBUG   ] summary = ERROR
2019-01-20 16:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229769  13 58503 60804701 A  ERRORERROR'
2019-01-20 16:53:24 [DEBUG   ] Got command RPT from MCS: ref #1229770
2019-01-20 16:53:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229770  77 58503 60804893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:53:25 [DEBUG   ] Got command RPT from MCS: ref #1229771
2019-01-20 16:53:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 16:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229771  12 58503 60805097 A  ERRORB¢ff'
2019-01-20 16:53:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:53:52 [DEBUG   ] Got command BAM from MCS: ref #1229773
2019-01-20 16:53:52 [INFO    ] Finished processing BAM request
2019-01-20 16:53:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:53:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229773   8 58503 60832033 A  ERROR'
2019-01-20 16:53:52 [DEBUG   ] Got command BAM from MCS: ref #1229772
2019-01-20 16:53:52 [INFO    ] Finished processing BAM request
2019-01-20 16:53:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:53:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229772   8 58503 60832037 A  ERROR'
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 16:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 16:53:52 [DEBUG   ] spawn_process: at 2019-01-20 16:53:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 16:53:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:53:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 16:53:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 16:53:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:53:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 16:53:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 16:53:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:53:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:53:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:53:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:53:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:53:58 [DEBUG   ] Finished updating board flags in 1.218 seconds
2019-01-20 16:54:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:54:25 [DEBUG   ] Got command BAM from MCS: ref #1229774
2019-01-20 16:54:25 [INFO    ] Finished processing BAM request
2019-01-20 16:54:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:54:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229774   8 58503 60865025 A  ERROR'
2019-01-20 16:54:25 [DEBUG   ] Got command BAM from MCS: ref #1229775
2019-01-20 16:54:25 [INFO    ] Finished processing BAM request
2019-01-20 16:54:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:54:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229775   8 58503 60865029 A  ERROR'
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 16:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 16:54:25 [DEBUG   ] spawn_process: at 2019-01-20 16:54:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 16:54:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:54:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:54:58 [DEBUG   ] Got command BAM from MCS: ref #1229777
2019-01-20 16:54:58 [INFO    ] Finished processing BAM request
2019-01-20 16:54:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229777   8 58503 60898029 A  ERROR'
2019-01-20 16:54:58 [DEBUG   ] Got command BAM from MCS: ref #1229776
2019-01-20 16:54:58 [INFO    ] Finished processing BAM request
2019-01-20 16:54:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229776   8 58503 60898033 A  ERROR'
2019-01-20 16:54:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 16:54:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 16:54:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 16:54:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:54:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 16:54:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:54:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:54:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:54:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:54:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:54:58 [DEBUG   ] Finished updating board flags in 1.194 seconds
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 16:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 16:54:58 [DEBUG   ] spawn_process: at 2019-01-20 16:54:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 16:55:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:55:31 [DEBUG   ] Got command BAM from MCS: ref #1229778
2019-01-20 16:55:31 [INFO    ] Finished processing BAM request
2019-01-20 16:55:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:55:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229778   8 58503 60931025 A  ERROR'
2019-01-20 16:55:31 [DEBUG   ] Got command BAM from MCS: ref #1229779
2019-01-20 16:55:31 [INFO    ] Finished processing BAM request
2019-01-20 16:55:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:55:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229779   8 58503 60931029 A  ERROR'
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 16:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 16:55:31 [DEBUG   ] spawn_process: at 2019-01-20 16:55:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 16:55:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:55:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 16:55:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:55:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 16:55:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 16:55:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 16:55:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:55:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:55:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:55:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:55:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:55:58 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-01-20 16:56:04 [DEBUG   ] Got command BAM from MCS: ref #1229785
2019-01-20 16:56:04 [INFO    ] Finished processing BAM request
2019-01-20 16:56:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229785   8 58503 60964037 A  ERROR'
2019-01-20 16:56:04 [DEBUG   ] Got command BAM from MCS: ref #1229784
2019-01-20 16:56:04 [INFO    ] Finished processing BAM request
2019-01-20 16:56:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229784   8 58503 60964041 A  ERROR'
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 16:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 16:56:04 [DEBUG   ] spawn_process: at 2019-01-20 16:56:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 16:56:06 [DEBUG   ] Got command RPT from MCS: ref #1229786
2019-01-20 16:56:06 [DEBUG   ] summary = ERROR
2019-01-20 16:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229786  13 58503 60966701 A  ERRORERROR'
2019-01-20 16:56:06 [DEBUG   ] Got command RPT from MCS: ref #1229787
2019-01-20 16:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229787  77 58503 60966702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:56:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:56:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:56:37 [DEBUG   ] Got command BAM from MCS: ref #1229804
2019-01-20 16:56:37 [INFO    ] Finished processing BAM request
2019-01-20 16:56:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229804   8 58503 60997033 A  ERROR'
2019-01-20 16:56:37 [DEBUG   ] Got command BAM from MCS: ref #1229803
2019-01-20 16:56:37 [INFO    ] Finished processing BAM request
2019-01-20 16:56:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229803   8 58503 60997037 A  ERROR'
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 16:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 16:56:37 [DEBUG   ] spawn_process: at 2019-01-20 16:56:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 16:56:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:56:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 16:56:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-20 16:56:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:56:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 16:56:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 16:56:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 16:56:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:56:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:56:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:56:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:56:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:56:58 [DEBUG   ] Finished updating board flags in 1.021 seconds
2019-01-20 16:57:10 [DEBUG   ] Got command BAM from MCS: ref #1229806
2019-01-20 16:57:10 [INFO    ] Finished processing BAM request
2019-01-20 16:57:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229806   8 58503 61030029 A  ERROR'
2019-01-20 16:57:10 [DEBUG   ] Got command BAM from MCS: ref #1229805
2019-01-20 16:57:10 [INFO    ] Finished processing BAM request
2019-01-20 16:57:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229805   8 58503 61030033 A  ERROR'
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 16:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 16:57:10 [DEBUG   ] spawn_process: at 2019-01-20 16:57:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 16:57:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:57:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:57:43 [DEBUG   ] Got command BAM from MCS: ref #1229807
2019-01-20 16:57:43 [INFO    ] Finished processing BAM request
2019-01-20 16:57:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229807   8 58503 61063037 A  ERROR'
2019-01-20 16:57:43 [DEBUG   ] Got command BAM from MCS: ref #1229808
2019-01-20 16:57:43 [INFO    ] Finished processing BAM request
2019-01-20 16:57:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229808   8 58503 61063045 A  ERROR'
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 16:57:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 16:57:43 [DEBUG   ] spawn_process: at 2019-01-20 16:57:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 16:57:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 16:57:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 16:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 16:57:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:57:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 16:57:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 16:57:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:57:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:57:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:57:58 [WARNING ] (13, 1, 'bot')
2019-01-20 16:57:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:57:58 [DEBUG   ] Finished updating board flags in 0.957 seconds
2019-01-20 16:58:16 [DEBUG   ] Got command BAM from MCS: ref #1229812
2019-01-20 16:58:16 [INFO    ] Finished processing BAM request
2019-01-20 16:58:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229812   8 58503 61096033 A  ERROR'
2019-01-20 16:58:16 [DEBUG   ] Got command BAM from MCS: ref #1229811
2019-01-20 16:58:16 [INFO    ] Finished processing BAM request
2019-01-20 16:58:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229811   8 58503 61096037 A  ERROR'
2019-01-20 16:58:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 16:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 16:58:16 [DEBUG   ] spawn_process: at 2019-01-20 16:58:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 16:58:24 [DEBUG   ] Got command RPT from MCS: ref #1229813
2019-01-20 16:58:24 [DEBUG   ] summary = ERROR
2019-01-20 16:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229813  13 58503 61104381 A  ERRORERROR'
2019-01-20 16:58:24 [DEBUG   ] Got command RPT from MCS: ref #1229814
2019-01-20 16:58:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229814  77 58503 61104573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:58:24 [DEBUG   ] Got command RPT from MCS: ref #1229815
2019-01-20 16:58:24 [DEBUG   ] summary = ERROR
2019-01-20 16:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229815  13 58503 61104777 A  ERRORERROR'
2019-01-20 16:58:24 [DEBUG   ] Got command RPT from MCS: ref #1229817
2019-01-20 16:58:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 16:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229817  77 58503 61104981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 16:58:25 [DEBUG   ] Got command RPT from MCS: ref #1229818
2019-01-20 16:58:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 16:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229818  12 58503 61105185 A  ERRORB£ff'
2019-01-20 16:58:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:58:49 [DEBUG   ] Got command BAM from MCS: ref #1229827
2019-01-20 16:58:49 [INFO    ] Finished processing BAM request
2019-01-20 16:58:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:58:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229827   8 58503 61129033 A  ERROR'
2019-01-20 16:58:49 [DEBUG   ] Got command BAM from MCS: ref #1229828
2019-01-20 16:58:49 [INFO    ] Finished processing BAM request
2019-01-20 16:58:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:58:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229828   8 58503 61129037 A  ERROR'
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 16:58:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 16:58:49 [DEBUG   ] spawn_process: at 2019-01-20 16:58:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 16:58:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 16:58:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 16:58:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:58:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 16:58:59 [WARNING ] (13, 1, 'bot')
2019-01-20 16:58:59 [WARNING ] (13, 1, 'bot')
2019-01-20 16:58:59 [WARNING ] (13, 1, 'bot')
2019-01-20 16:58:59 [WARNING ] (13, 1, 'bot')
2019-01-20 16:58:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:58:59 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-01-20 16:59:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:59:22 [DEBUG   ] Got command BAM from MCS: ref #1229830
2019-01-20 16:59:22 [INFO    ] Finished processing BAM request
2019-01-20 16:59:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229830   8 58503 61162029 A  ERROR'
2019-01-20 16:59:22 [DEBUG   ] Got command BAM from MCS: ref #1229829
2019-01-20 16:59:22 [INFO    ] Finished processing BAM request
2019-01-20 16:59:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229829   8 58503 61162033 A  ERROR'
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 16:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 16:59:22 [DEBUG   ] spawn_process: at 2019-01-20 16:59:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 16:59:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:59:55 [DEBUG   ] Got command BAM from MCS: ref #1229832
2019-01-20 16:59:55 [INFO    ] Finished processing BAM request
2019-01-20 16:59:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229832   8 58503 61195033 A  ERROR'
2019-01-20 16:59:55 [DEBUG   ] Got command BAM from MCS: ref #1229831
2019-01-20 16:59:55 [INFO    ] Finished processing BAM request
2019-01-20 16:59:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 16:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229831   8 58503 61195037 A  ERROR'
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 16:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 16:59:55 [DEBUG   ] spawn_process: at 2019-01-20 16:59:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 16:59:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 16:59:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 16:59:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 16:59:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 16:59:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 16:59:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 16:59:59 [WARNING ] (13, 1, 'bot')
2019-01-20 16:59:59 [WARNING ] (13, 1, 'bot')
2019-01-20 16:59:59 [WARNING ] (13, 1, 'bot')
2019-01-20 16:59:59 [WARNING ] (13, 1, 'bot')
2019-01-20 16:59:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 16:59:59 [DEBUG   ] Finished updating board flags in 1.198 seconds
2019-01-20 17:00:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 17:00:27 [DEBUG   ] Got command BAM from MCS: ref #1229834
2019-01-20 17:00:27 [INFO    ] Finished processing BAM request
2019-01-20 17:00:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229834   8 58503 61227029 A  ERROR'
2019-01-20 17:00:27 [DEBUG   ] Got command BAM from MCS: ref #1229833
2019-01-20 17:00:27 [INFO    ] Finished processing BAM request
2019-01-20 17:00:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229833   8 58503 61227033 A  ERROR'
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:00:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:00:27 [DEBUG   ] spawn_process: at 2019-01-20 17:00:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:00:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:00:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:00:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:00:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:00:59 [DEBUG   ] Got command BAM from MCS: ref #1229836
2019-01-20 17:00:59 [INFO    ] Finished processing BAM request
2019-01-20 17:00:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229836   8 58503 61259033 A  ERROR'
2019-01-20 17:00:59 [DEBUG   ] Got command BAM from MCS: ref #1229835
2019-01-20 17:00:59 [INFO    ] Finished processing BAM request
2019-01-20 17:00:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229835   8 58503 61259037 A  ERROR'
2019-01-20 17:00:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:00:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 17:00:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:00:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:00:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:00:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:00:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:00:59 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:00:59 [DEBUG   ] spawn_process: at 2019-01-20 17:00:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:01:06 [DEBUG   ] Got command RPT from MCS: ref #1229837
2019-01-20 17:01:06 [DEBUG   ] summary = ERROR
2019-01-20 17:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229837  13 58503 61266693 A  ERRORERROR'
2019-01-20 17:01:06 [DEBUG   ] Got command RPT from MCS: ref #1229838
2019-01-20 17:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229838  77 58503 61266694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:01:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:01:31 [DEBUG   ] Got command BAM from MCS: ref #1229855
2019-01-20 17:01:31 [INFO    ] Finished processing BAM request
2019-01-20 17:01:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:01:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229855   8 58503 61291025 A  ERROR'
2019-01-20 17:01:31 [DEBUG   ] Got command BAM from MCS: ref #1229854
2019-01-20 17:01:31 [INFO    ] Finished processing BAM request
2019-01-20 17:01:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:01:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229854   8 58503 61291029 A  ERROR'
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:01:31 [DEBUG   ] spawn_process: at 2019-01-20 17:01:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:01:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:01:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:01:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:02:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 17:02:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:02:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 17:02:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:02:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:02:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:02:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:02:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:02:00 [DEBUG   ] Finished updating board flags in 1.872 seconds
2019-01-20 17:02:03 [DEBUG   ] Got command BAM from MCS: ref #1229860
2019-01-20 17:02:03 [INFO    ] Finished processing BAM request
2019-01-20 17:02:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:02:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229860   8 58503 61323025 A  ERROR'
2019-01-20 17:02:03 [DEBUG   ] Got command BAM from MCS: ref #1229861
2019-01-20 17:02:03 [INFO    ] Finished processing BAM request
2019-01-20 17:02:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:02:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229861   8 58503 61323029 A  ERROR'
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:02:03 [DEBUG   ] spawn_process: at 2019-01-20 17:02:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:02:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:02:35 [DEBUG   ] Got command BAM from MCS: ref #1229863
2019-01-20 17:02:35 [INFO    ] Finished processing BAM request
2019-01-20 17:02:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229863   8 58503 61355033 A  ERROR'
2019-01-20 17:02:35 [DEBUG   ] Got command BAM from MCS: ref #1229862
2019-01-20 17:02:35 [INFO    ] Finished processing BAM request
2019-01-20 17:02:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229862   8 58503 61355037 A  ERROR'
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:02:35 [DEBUG   ] spawn_process: at 2019-01-20 17:02:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:02:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:02:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:02:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:03:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:03:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:03:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:03:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:03:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:03:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:03:00 [DEBUG   ] Finished updating board flags in 1.745 seconds
2019-01-20 17:03:07 [DEBUG   ] Got command BAM from MCS: ref #1229864
2019-01-20 17:03:07 [INFO    ] Finished processing BAM request
2019-01-20 17:03:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:03:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229864   8 58503 61387033 A  ERROR'
2019-01-20 17:03:07 [DEBUG   ] Got command BAM from MCS: ref #1229865
2019-01-20 17:03:07 [INFO    ] Finished processing BAM request
2019-01-20 17:03:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:03:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229865   8 58503 61387037 A  ERROR'
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:03:07 [DEBUG   ] spawn_process: at 2019-01-20 17:03:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:03:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:03:24 [DEBUG   ] Got command RPT from MCS: ref #1229866
2019-01-20 17:03:24 [DEBUG   ] summary = ERROR
2019-01-20 17:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229866  13 58503 61404465 A  ERRORERROR'
2019-01-20 17:03:24 [DEBUG   ] Got command RPT from MCS: ref #1229867
2019-01-20 17:03:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229867  77 58503 61404669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:03:24 [DEBUG   ] Got command RPT from MCS: ref #1229868
2019-01-20 17:03:24 [DEBUG   ] summary = ERROR
2019-01-20 17:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229868  13 58503 61404861 A  ERRORERROR'
2019-01-20 17:03:25 [DEBUG   ] Got command RPT from MCS: ref #1229869
2019-01-20 17:03:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229869  77 58503 61405065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:03:25 [DEBUG   ] Got command RPT from MCS: ref #1229870
2019-01-20 17:03:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 17:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229870  12 58503 61405269 A  ERRORB¢ff'
2019-01-20 17:03:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:03:39 [DEBUG   ] Got command BAM from MCS: ref #1229872
2019-01-20 17:03:39 [INFO    ] Finished processing BAM request
2019-01-20 17:03:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229872   8 58503 61419033 A  ERROR'
2019-01-20 17:03:39 [DEBUG   ] Got command BAM from MCS: ref #1229871
2019-01-20 17:03:39 [INFO    ] Finished processing BAM request
2019-01-20 17:03:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229871   8 58503 61419037 A  ERROR'
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:03:39 [DEBUG   ] spawn_process: at 2019-01-20 17:03:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:03:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:03:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:03:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:03:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 17:03:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:03:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 17:03:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:03:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:03:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:03:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:03:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:03:59 [DEBUG   ] Finished updating board flags in 1.039 seconds
2019-01-20 17:04:11 [DEBUG   ] Got command BAM from MCS: ref #1229874
2019-01-20 17:04:11 [INFO    ] Finished processing BAM request
2019-01-20 17:04:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229874   8 58503 61451033 A  ERROR'
2019-01-20 17:04:11 [DEBUG   ] Got command BAM from MCS: ref #1229873
2019-01-20 17:04:11 [INFO    ] Finished processing BAM request
2019-01-20 17:04:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229873   8 58503 61451037 A  ERROR'
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:04:11 [DEBUG   ] spawn_process: at 2019-01-20 17:04:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:04:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:04:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:04:43 [DEBUG   ] Got command BAM from MCS: ref #1229879
2019-01-20 17:04:43 [INFO    ] Finished processing BAM request
2019-01-20 17:04:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229879   8 58503 61483029 A  ERROR'
2019-01-20 17:04:43 [DEBUG   ] Got command BAM from MCS: ref #1229880
2019-01-20 17:04:43 [INFO    ] Finished processing BAM request
2019-01-20 17:04:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229880   8 58503 61483033 A  ERROR'
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:04:43 [DEBUG   ] spawn_process: at 2019-01-20 17:04:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:04:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:04:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:04:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:04:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:04:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:04:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:04:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:04:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:04:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:04:59 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-01-20 17:05:15 [DEBUG   ] Got command BAM from MCS: ref #1229881
2019-01-20 17:05:15 [INFO    ] Finished processing BAM request
2019-01-20 17:05:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229881   8 58503 61515029 A  ERROR'
2019-01-20 17:05:15 [DEBUG   ] Got command BAM from MCS: ref #1229882
2019-01-20 17:05:15 [INFO    ] Finished processing BAM request
2019-01-20 17:05:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229882   8 58503 61515033 A  ERROR'
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:05:15 [DEBUG   ] spawn_process: at 2019-01-20 17:05:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:05:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 17:05:37 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2019-01-20 17:05:47 [DEBUG   ] Got command BAM from MCS: ref #1229883
2019-01-20 17:05:47 [INFO    ] Finished processing BAM request
2019-01-20 17:05:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:05:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229883   8 58503 61547033 A  ERROR'
2019-01-20 17:05:47 [DEBUG   ] Got command BAM from MCS: ref #1229884
2019-01-20 17:05:47 [INFO    ] Finished processing BAM request
2019-01-20 17:05:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:05:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229884   8 58503 61547037 A  ERROR'
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:05:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:05:47 [DEBUG   ] spawn_process: at 2019-01-20 17:05:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:05:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:05:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 17:05:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:05:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:05:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:05:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:05:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:05:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:05:59 [WARNING ] (13, 1, 'bot')
2019-01-20 17:05:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:05:59 [DEBUG   ] Finished updating board flags in 0.989 seconds
2019-01-20 17:06:06 [DEBUG   ] Got command RPT from MCS: ref #1229885
2019-01-20 17:06:06 [DEBUG   ] summary = ERROR
2019-01-20 17:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229885  13 58503 61566705 A  ERRORERROR'
2019-01-20 17:06:06 [DEBUG   ] Got command RPT from MCS: ref #1229886
2019-01-20 17:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229886  77 58503 61566706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:06:17 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2019-01-20 17:06:19 [DEBUG   ] Got command BAM from MCS: ref #1229903
2019-01-20 17:06:19 [INFO    ] Finished processing BAM request
2019-01-20 17:06:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:06:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229903   8 58503 61579029 A  ERROR'
2019-01-20 17:06:19 [DEBUG   ] Got command BAM from MCS: ref #1229902
2019-01-20 17:06:19 [INFO    ] Finished processing BAM request
2019-01-20 17:06:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:06:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229902   8 58503 61579033 A  ERROR'
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:06:19 [DEBUG   ] spawn_process: at 2019-01-20 17:06:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:06:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:06:51 [DEBUG   ] Got command BAM from MCS: ref #1229904
2019-01-20 17:06:51 [INFO    ] Finished processing BAM request
2019-01-20 17:06:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229904   8 58503 61611030 A  ERROR'
2019-01-20 17:06:51 [DEBUG   ] Got command BAM from MCS: ref #1229905
2019-01-20 17:06:51 [INFO    ] Finished processing BAM request
2019-01-20 17:06:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229905   8 58503 61611034 A  ERROR'
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:06:51 [DEBUG   ] spawn_process: at 2019-01-20 17:06:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:06:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:06:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 17:06:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-20 17:06:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:07:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 17:07:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:07:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:07:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:07:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:07:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:07:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:07:00 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-01-20 17:07:16 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-20 17:07:23 [DEBUG   ] Got command BAM from MCS: ref #1229907
2019-01-20 17:07:23 [INFO    ] Finished processing BAM request
2019-01-20 17:07:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229907   8 58503 61643030 A  ERROR'
2019-01-20 17:07:23 [DEBUG   ] Got command BAM from MCS: ref #1229906
2019-01-20 17:07:23 [INFO    ] Finished processing BAM request
2019-01-20 17:07:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229906   8 58503 61643034 A  ERROR'
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:07:23 [DEBUG   ] spawn_process: at 2019-01-20 17:07:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:07:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:07:55 [DEBUG   ] Got command BAM from MCS: ref #1229912
2019-01-20 17:07:55 [INFO    ] Finished processing BAM request
2019-01-20 17:07:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:07:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229912   8 58503 61675030 A  ERROR'
2019-01-20 17:07:55 [DEBUG   ] Got command BAM from MCS: ref #1229913
2019-01-20 17:07:55 [INFO    ] Finished processing BAM request
2019-01-20 17:07:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:07:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229913   8 58503 61675034 A  ERROR'
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:07:55 [DEBUG   ] spawn_process: at 2019-01-20 17:07:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:07:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:07:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:07:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:07:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 17:08:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:08:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:08:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:08:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:08:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:08:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:08:00 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-01-20 17:08:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:08:24 [DEBUG   ] Got command RPT from MCS: ref #1229916
2019-01-20 17:08:24 [DEBUG   ] summary = ERROR
2019-01-20 17:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229916  13 58503 61704549 A  ERRORERROR'
2019-01-20 17:08:24 [DEBUG   ] Got command RPT from MCS: ref #1229917
2019-01-20 17:08:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229917  77 58503 61704753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:08:24 [DEBUG   ] Got command RPT from MCS: ref #1229918
2019-01-20 17:08:24 [DEBUG   ] summary = ERROR
2019-01-20 17:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229918  13 58503 61704945 A  ERRORERROR'
2019-01-20 17:08:25 [DEBUG   ] Got command RPT from MCS: ref #1229920
2019-01-20 17:08:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229920  77 58503 61705149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:08:25 [DEBUG   ] Got command RPT from MCS: ref #1229922
2019-01-20 17:08:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 17:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229922  12 58503 61705353 A  ERRORB¢ff'
2019-01-20 17:08:27 [DEBUG   ] Got command BAM from MCS: ref #1229926
2019-01-20 17:08:27 [INFO    ] Finished processing BAM request
2019-01-20 17:08:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229926   8 58503 61707025 A  ERROR'
2019-01-20 17:08:27 [DEBUG   ] Got command BAM from MCS: ref #1229927
2019-01-20 17:08:27 [INFO    ] Finished processing BAM request
2019-01-20 17:08:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229927   8 58503 61707029 A  ERROR'
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:08:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:08:27 [DEBUG   ] spawn_process: at 2019-01-20 17:08:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:08:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 17:08:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 17:08:59 [DEBUG   ] Got command BAM from MCS: ref #1229929
2019-01-20 17:08:59 [INFO    ] Finished processing BAM request
2019-01-20 17:08:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229929   8 58503 61739025 A  ERROR'
2019-01-20 17:08:59 [DEBUG   ] Got command BAM from MCS: ref #1229928
2019-01-20 17:08:59 [INFO    ] Finished processing BAM request
2019-01-20 17:08:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229928   8 58503 61739029 A  ERROR'
2019-01-20 17:08:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 17:08:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:08:59 [DEBUG   ] spawn_process: at 2019-01-20 17:08:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:09:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:09:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:09:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:09:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:09:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:09:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:09:00 [DEBUG   ] Finished updating board flags in 1.197 seconds
2019-01-20 17:09:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 17:09:31 [DEBUG   ] Got command BAM from MCS: ref #1229931
2019-01-20 17:09:31 [INFO    ] Finished processing BAM request
2019-01-20 17:09:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229931   8 58503 61771029 A  ERROR'
2019-01-20 17:09:31 [DEBUG   ] Got command BAM from MCS: ref #1229930
2019-01-20 17:09:31 [INFO    ] Finished processing BAM request
2019-01-20 17:09:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229930   8 58503 61771033 A  ERROR'
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:09:31 [DEBUG   ] spawn_process: at 2019-01-20 17:09:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:09:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:09:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:09:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 17:09:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:09:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:10:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:10:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:10:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:10:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:10:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:10:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:10:00 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-01-20 17:10:03 [DEBUG   ] Got command BAM from MCS: ref #1229932
2019-01-20 17:10:03 [INFO    ] Finished processing BAM request
2019-01-20 17:10:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229932   8 58503 61803033 A  ERROR'
2019-01-20 17:10:03 [DEBUG   ] Got command BAM from MCS: ref #1229933
2019-01-20 17:10:03 [INFO    ] Finished processing BAM request
2019-01-20 17:10:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229933   8 58503 61803037 A  ERROR'
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:10:03 [DEBUG   ] spawn_process: at 2019-01-20 17:10:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:10:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:10:35 [DEBUG   ] Got command BAM from MCS: ref #1229939
2019-01-20 17:10:35 [INFO    ] Finished processing BAM request
2019-01-20 17:10:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:10:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229939   8 58503 61835029 A  ERROR'
2019-01-20 17:10:35 [DEBUG   ] Got command BAM from MCS: ref #1229938
2019-01-20 17:10:35 [INFO    ] Finished processing BAM request
2019-01-20 17:10:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:10:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229938   8 58503 61835033 A  ERROR'
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:10:35 [DEBUG   ] spawn_process: at 2019-01-20 17:10:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:10:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:10:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:10:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 17:10:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:10:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 17:11:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:11:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 17:11:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:11:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:11:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:11:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:11:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:11:00 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-01-20 17:11:06 [DEBUG   ] Got command RPT from MCS: ref #1229942
2019-01-20 17:11:06 [DEBUG   ] summary = ERROR
2019-01-20 17:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229942  13 58503 61866705 A  ERRORERROR'
2019-01-20 17:11:06 [DEBUG   ] Got command RPT from MCS: ref #1229943
2019-01-20 17:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229943  77 58503 61866706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:11:07 [DEBUG   ] Got command BAM from MCS: ref #1229940
2019-01-20 17:11:07 [INFO    ] Finished processing BAM request
2019-01-20 17:11:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:11:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229940   8 58503 61867033 A  ERROR'
2019-01-20 17:11:07 [DEBUG   ] Got command BAM from MCS: ref #1229941
2019-01-20 17:11:07 [INFO    ] Finished processing BAM request
2019-01-20 17:11:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:11:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229941   8 58503 61867037 A  ERROR'
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:11:07 [DEBUG   ] spawn_process: at 2019-01-20 17:11:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:11:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 17:11:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:11:39 [DEBUG   ] Got command BAM from MCS: ref #1229960
2019-01-20 17:11:39 [INFO    ] Finished processing BAM request
2019-01-20 17:11:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229960   8 58503 61899029 A  ERROR'
2019-01-20 17:11:39 [DEBUG   ] Got command BAM from MCS: ref #1229959
2019-01-20 17:11:39 [INFO    ] Finished processing BAM request
2019-01-20 17:11:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229959   8 58503 61899033 A  ERROR'
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:11:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:11:39 [DEBUG   ] spawn_process: at 2019-01-20 17:11:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:11:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:11:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 17:11:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:11:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:12:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:12:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:12:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:12:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:12:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:12:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:12:00 [DEBUG   ] Finished updating board flags in 0.975 seconds
2019-01-20 17:12:11 [DEBUG   ] Got command BAM from MCS: ref #1229962
2019-01-20 17:12:11 [INFO    ] Finished processing BAM request
2019-01-20 17:12:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:12:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229962   8 58503 61931025 A  ERROR'
2019-01-20 17:12:11 [DEBUG   ] Got command BAM from MCS: ref #1229961
2019-01-20 17:12:11 [INFO    ] Finished processing BAM request
2019-01-20 17:12:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:12:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229961   8 58503 61931029 A  ERROR'
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:12:11 [DEBUG   ] spawn_process: at 2019-01-20 17:12:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:12:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 17:12:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:12:43 [DEBUG   ] Got command BAM from MCS: ref #1229963
2019-01-20 17:12:43 [INFO    ] Finished processing BAM request
2019-01-20 17:12:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229963   8 58503 61963033 A  ERROR'
2019-01-20 17:12:43 [DEBUG   ] Got command BAM from MCS: ref #1229964
2019-01-20 17:12:43 [INFO    ] Finished processing BAM request
2019-01-20 17:12:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229964   8 58503 61963037 A  ERROR'
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:12:43 [DEBUG   ] spawn_process: at 2019-01-20 17:12:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:12:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 17:13:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 17:13:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:13:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 17:13:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:13:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 17:13:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 17:13:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:13:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:13:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:13:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:13:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:13:00 [DEBUG   ] Finished updating board flags in 1.284 seconds
2019-01-20 17:13:14 [DEBUG   ] Got command BAM from MCS: ref #1229966
2019-01-20 17:13:14 [INFO    ] Finished processing BAM request
2019-01-20 17:13:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229966   8 58503 61994029 A  ERROR'
2019-01-20 17:13:14 [DEBUG   ] Got command BAM from MCS: ref #1229965
2019-01-20 17:13:14 [INFO    ] Finished processing BAM request
2019-01-20 17:13:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229965   8 58503 61994033 A  ERROR'
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:13:14 [DEBUG   ] spawn_process: at 2019-01-20 17:13:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:13:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 17:13:24 [DEBUG   ] Got command RPT from MCS: ref #1229967
2019-01-20 17:13:24 [DEBUG   ] summary = ERROR
2019-01-20 17:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229967  13 58503 62004633 A  ERRORERROR'
2019-01-20 17:13:24 [DEBUG   ] Got command RPT from MCS: ref #1229968
2019-01-20 17:13:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229968  77 58503 62004837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:13:25 [DEBUG   ] Got command RPT from MCS: ref #1229969
2019-01-20 17:13:25 [DEBUG   ] summary = ERROR
2019-01-20 17:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229969  13 58503 62005041 A  ERRORERROR'
2019-01-20 17:13:25 [DEBUG   ] Got command RPT from MCS: ref #1229970
2019-01-20 17:13:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229970  77 58503 62005233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:13:25 [DEBUG   ] Got command RPT from MCS: ref #1229971
2019-01-20 17:13:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 17:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229971  12 58503 62005437 A  ERRORB£ff'
2019-01-20 17:13:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:13:45 [DEBUG   ] Got command BAM from MCS: ref #1229977
2019-01-20 17:13:45 [INFO    ] Finished processing BAM request
2019-01-20 17:13:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:13:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229977   8 58503 62025033 A  ERROR'
2019-01-20 17:13:45 [DEBUG   ] Got command BAM from MCS: ref #1229976
2019-01-20 17:13:45 [INFO    ] Finished processing BAM request
2019-01-20 17:13:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:13:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229976   8 58503 62025037 A  ERROR'
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:13:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:13:45 [DEBUG   ] spawn_process: at 2019-01-20 17:13:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:13:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 17:14:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:14:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-20 17:14:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:14:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 17:14:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:14:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:14:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:14:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:14:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:14:00 [DEBUG   ] Finished updating board flags in 1.170 seconds
2019-01-20 17:14:16 [DEBUG   ] Got command BAM from MCS: ref #1229978
2019-01-20 17:14:16 [INFO    ] Finished processing BAM request
2019-01-20 17:14:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229978   8 58503 62056025 A  ERROR'
2019-01-20 17:14:16 [DEBUG   ] Got command BAM from MCS: ref #1229979
2019-01-20 17:14:16 [INFO    ] Finished processing BAM request
2019-01-20 17:14:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229979   8 58503 62056029 A  ERROR'
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:14:16 [DEBUG   ] spawn_process: at 2019-01-20 17:14:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:14:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:14:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:14:47 [DEBUG   ] Got command BAM from MCS: ref #1229980
2019-01-20 17:14:47 [INFO    ] Finished processing BAM request
2019-01-20 17:14:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229980   8 58503 62087033 A  ERROR'
2019-01-20 17:14:47 [DEBUG   ] Got command BAM from MCS: ref #1229981
2019-01-20 17:14:47 [INFO    ] Finished processing BAM request
2019-01-20 17:14:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229981   8 58503 62087037 A  ERROR'
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:14:47 [DEBUG   ] spawn_process: at 2019-01-20 17:14:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:14:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 17:15:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:15:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:15:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:15:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 17:15:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 17:15:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:15:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:15:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:15:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:15:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:15:00 [DEBUG   ] Finished updating board flags in 1.018 seconds
2019-01-20 17:15:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:15:18 [DEBUG   ] Got command BAM from MCS: ref #1229983
2019-01-20 17:15:18 [INFO    ] Finished processing BAM request
2019-01-20 17:15:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229983   8 58503 62118029 A  ERROR'
2019-01-20 17:15:18 [DEBUG   ] Got command BAM from MCS: ref #1229982
2019-01-20 17:15:18 [INFO    ] Finished processing BAM request
2019-01-20 17:15:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229982   8 58503 62118033 A  ERROR'
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:15:18 [DEBUG   ] spawn_process: at 2019-01-20 17:15:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:15:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:15:49 [DEBUG   ] Got command BAM from MCS: ref #1229984
2019-01-20 17:15:49 [INFO    ] Finished processing BAM request
2019-01-20 17:15:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229984   8 58503 62149041 A  ERROR'
2019-01-20 17:15:49 [DEBUG   ] Got command BAM from MCS: ref #1229985
2019-01-20 17:15:49 [INFO    ] Finished processing BAM request
2019-01-20 17:15:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1229985   8 58503 62149045 A  ERROR'
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:15:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:15:49 [DEBUG   ] spawn_process: at 2019-01-20 17:15:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:15:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:16:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:16:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:16:00 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 17:16:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 17:16:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:16:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:16:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:16:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:16:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:16:00 [DEBUG   ] Finished updating board flags in 1.005 seconds
2019-01-20 17:16:06 [DEBUG   ] Got command RPT from MCS: ref #1229986
2019-01-20 17:16:06 [DEBUG   ] summary = ERROR
2019-01-20 17:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229986  13 58503 62166705 A  ERRORERROR'
2019-01-20 17:16:06 [DEBUG   ] Got command RPT from MCS: ref #1229987
2019-01-20 17:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1229987  77 58503 62166706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:16:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:16:20 [DEBUG   ] Got command BAM from MCS: ref #1230004
2019-01-20 17:16:20 [INFO    ] Finished processing BAM request
2019-01-20 17:16:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:16:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230004   8 58503 62180033 A  ERROR'
2019-01-20 17:16:20 [DEBUG   ] Got command BAM from MCS: ref #1230003
2019-01-20 17:16:20 [INFO    ] Finished processing BAM request
2019-01-20 17:16:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:16:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230003   8 58503 62180037 A  ERROR'
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:16:20 [DEBUG   ] spawn_process: at 2019-01-20 17:16:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:16:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 17:16:51 [DEBUG   ] Got command BAM from MCS: ref #1230009
2019-01-20 17:16:51 [INFO    ] Finished processing BAM request
2019-01-20 17:16:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230009   8 58503 62211029 A  ERROR'
2019-01-20 17:16:51 [DEBUG   ] Got command BAM from MCS: ref #1230010
2019-01-20 17:16:51 [INFO    ] Finished processing BAM request
2019-01-20 17:16:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230010   8 58503 62211033 A  ERROR'
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:16:51 [DEBUG   ] spawn_process: at 2019-01-20 17:16:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:16:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:17:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:17:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:17:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:17:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:17:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:17:00 [WARNING ] (13, 1, 'bot')
2019-01-20 17:17:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:17:00 [DEBUG   ] Finished updating board flags in 0.986 seconds
2019-01-20 17:17:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:17:22 [DEBUG   ] Got command BAM from MCS: ref #1230011
2019-01-20 17:17:22 [INFO    ] Finished processing BAM request
2019-01-20 17:17:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230011   8 58503 62242025 A  ERROR'
2019-01-20 17:17:22 [DEBUG   ] Got command BAM from MCS: ref #1230012
2019-01-20 17:17:22 [INFO    ] Finished processing BAM request
2019-01-20 17:17:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230012   8 58503 62242029 A  ERROR'
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:17:22 [DEBUG   ] spawn_process: at 2019-01-20 17:17:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:17:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 17:17:53 [DEBUG   ] Got command BAM from MCS: ref #1230013
2019-01-20 17:17:53 [INFO    ] Finished processing BAM request
2019-01-20 17:17:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:17:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230013   8 58503 62273029 A  ERROR'
2019-01-20 17:17:53 [DEBUG   ] Got command BAM from MCS: ref #1230014
2019-01-20 17:17:53 [INFO    ] Finished processing BAM request
2019-01-20 17:17:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:17:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230014   8 58503 62273033 A  ERROR'
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:17:53 [DEBUG   ] spawn_process: at 2019-01-20 17:17:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:17:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 17:18:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:18:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:18:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:18:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:18:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:18:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:18:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:18:01 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-01-20 17:18:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 17:18:24 [DEBUG   ] Got command BAM from MCS: ref #1230018
2019-01-20 17:18:24 [INFO    ] Finished processing BAM request
2019-01-20 17:18:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230018   8 58503 62304037 A  ERROR'
2019-01-20 17:18:24 [DEBUG   ] Got command BAM from MCS: ref #1230017
2019-01-20 17:18:24 [INFO    ] Finished processing BAM request
2019-01-20 17:18:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230017   8 58503 62304045 A  ERROR'
2019-01-20 17:18:24 [DEBUG   ] Got command RPT from MCS: ref #1230019
2019-01-20 17:18:24 [DEBUG   ] summary = ERROR
2019-01-20 17:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230019  13 58503 62304713 A  ERRORERROR'
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:18:24 [DEBUG   ] Got command RPT from MCS: ref #1230020
2019-01-20 17:18:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230020  77 58503 62304921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:18:24 [DEBUG   ] spawn_process: at 2019-01-20 17:18:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:18:25 [DEBUG   ] Got command RPT from MCS: ref #1230021
2019-01-20 17:18:25 [DEBUG   ] summary = ERROR
2019-01-20 17:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230021  13 58503 62305125 A  ERRORERROR'
2019-01-20 17:18:25 [DEBUG   ] Got command RPT from MCS: ref #1230023
2019-01-20 17:18:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230023  77 58503 62305317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:18:25 [DEBUG   ] Got command RPT from MCS: ref #1230024
2019-01-20 17:18:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 17:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230024  12 58503 62305521 A  ERRORB¢ff'
2019-01-20 17:18:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 17:18:55 [DEBUG   ] Got command BAM from MCS: ref #1230030
2019-01-20 17:18:55 [INFO    ] Finished processing BAM request
2019-01-20 17:18:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230030   8 58503 62335025 A  ERROR'
2019-01-20 17:18:55 [DEBUG   ] Got command BAM from MCS: ref #1230029
2019-01-20 17:18:55 [INFO    ] Finished processing BAM request
2019-01-20 17:18:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230029   8 58503 62335029 A  ERROR'
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:18:55 [DEBUG   ] spawn_process: at 2019-01-20 17:18:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:18:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 17:19:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:19:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 17:19:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:19:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:19:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:19:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:19:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:19:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:19:01 [DEBUG   ] Finished updating board flags in 1.205 seconds
2019-01-20 17:19:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 17:19:26 [DEBUG   ] Got command BAM from MCS: ref #1230032
2019-01-20 17:19:26 [INFO    ] Finished processing BAM request
2019-01-20 17:19:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:19:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230032   8 58503 62366029 A  ERROR'
2019-01-20 17:19:26 [DEBUG   ] Got command BAM from MCS: ref #1230031
2019-01-20 17:19:26 [INFO    ] Finished processing BAM request
2019-01-20 17:19:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:19:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230031   8 58503 62366033 A  ERROR'
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:19:26 [DEBUG   ] spawn_process: at 2019-01-20 17:19:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:19:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 17:19:57 [DEBUG   ] Got command BAM from MCS: ref #1230037
2019-01-20 17:19:57 [INFO    ] Finished processing BAM request
2019-01-20 17:19:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230037   8 58503 62397029 A  ERROR'
2019-01-20 17:19:57 [DEBUG   ] Got command BAM from MCS: ref #1230038
2019-01-20 17:19:57 [INFO    ] Finished processing BAM request
2019-01-20 17:19:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230038   8 58503 62397033 A  ERROR'
2019-01-20 17:19:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:19:57 [DEBUG   ] spawn_process: at 2019-01-20 17:19:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:20:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 17:20:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:20:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:20:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:20:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:20:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:20:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:20:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:20:01 [DEBUG   ] Finished updating board flags in 1.194 seconds
2019-01-20 17:20:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 17:20:28 [DEBUG   ] Got command BAM from MCS: ref #1230039
2019-01-20 17:20:28 [INFO    ] Finished processing BAM request
2019-01-20 17:20:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230039   8 58503 62428029 A  ERROR'
2019-01-20 17:20:28 [DEBUG   ] Got command BAM from MCS: ref #1230040
2019-01-20 17:20:28 [INFO    ] Finished processing BAM request
2019-01-20 17:20:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230040   8 58503 62428033 A  ERROR'
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:20:28 [DEBUG   ] spawn_process: at 2019-01-20 17:20:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:20:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 17:20:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 17:20:59 [DEBUG   ] Got command BAM from MCS: ref #1230041
2019-01-20 17:20:59 [INFO    ] Finished processing BAM request
2019-01-20 17:20:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230041   8 58503 62459025 A  ERROR'
2019-01-20 17:20:59 [DEBUG   ] Got command BAM from MCS: ref #1230042
2019-01-20 17:20:59 [INFO    ] Finished processing BAM request
2019-01-20 17:20:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230042   8 58503 62459029 A  ERROR'
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:20:59 [DEBUG   ] spawn_process: at 2019-01-20 17:20:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:21:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 17:21:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:21:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:21:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 17:21:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 17:21:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:21:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:21:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:21:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:21:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:21:01 [DEBUG   ] Finished updating board flags in 1.002 seconds
2019-01-20 17:21:06 [DEBUG   ] Got command RPT from MCS: ref #1230043
2019-01-20 17:21:06 [DEBUG   ] summary = ERROR
2019-01-20 17:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230043  13 58503 62466709 A  ERRORERROR'
2019-01-20 17:21:06 [DEBUG   ] Got command RPT from MCS: ref #1230044
2019-01-20 17:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230044  77 58503 62466710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:21:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 17:21:30 [DEBUG   ] Got command BAM from MCS: ref #1230061
2019-01-20 17:21:30 [INFO    ] Finished processing BAM request
2019-01-20 17:21:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:21:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230061   8 58503 62490033 A  ERROR'
2019-01-20 17:21:30 [DEBUG   ] Got command BAM from MCS: ref #1230060
2019-01-20 17:21:30 [INFO    ] Finished processing BAM request
2019-01-20 17:21:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:21:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230060   8 58503 62490037 A  ERROR'
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:21:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:21:30 [DEBUG   ] spawn_process: at 2019-01-20 17:21:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:21:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 17:21:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 17:22:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:22:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:22:01 [DEBUG   ] Got command BAM from MCS: ref #1230063
2019-01-20 17:22:01 [INFO    ] Finished processing BAM request
2019-01-20 17:22:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230063   8 58503 62521025 A  ERROR'
2019-01-20 17:22:01 [DEBUG   ] Got command BAM from MCS: ref #1230062
2019-01-20 17:22:01 [INFO    ] Finished processing BAM request
2019-01-20 17:22:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230062   8 58503 62521029 A  ERROR'
2019-01-20 17:22:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:22:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:22:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:22:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:22:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:22:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:22:01 [DEBUG   ] Finished updating board flags in 1.072 seconds
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:22:01 [DEBUG   ] spawn_process: at 2019-01-20 17:22:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:22:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 17:22:32 [DEBUG   ] Got command BAM from MCS: ref #1230065
2019-01-20 17:22:32 [INFO    ] Finished processing BAM request
2019-01-20 17:22:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230065   8 58503 62552033 A  ERROR'
2019-01-20 17:22:32 [DEBUG   ] Got command BAM from MCS: ref #1230064
2019-01-20 17:22:32 [INFO    ] Finished processing BAM request
2019-01-20 17:22:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230064   8 58503 62552037 A  ERROR'
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:22:32 [DEBUG   ] spawn_process: at 2019-01-20 17:22:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:22:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:22:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:23:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:23:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:23:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:23:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:23:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:23:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:23:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:23:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:23:02 [DEBUG   ] Finished updating board flags in 2.002 seconds
2019-01-20 17:23:03 [DEBUG   ] Got command BAM from MCS: ref #1230071
2019-01-20 17:23:03 [INFO    ] Finished processing BAM request
2019-01-20 17:23:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:23:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230071   8 58503 62583025 A  ERROR'
2019-01-20 17:23:03 [DEBUG   ] Got command BAM from MCS: ref #1230070
2019-01-20 17:23:03 [INFO    ] Finished processing BAM request
2019-01-20 17:23:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:23:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230070   8 58503 62583029 A  ERROR'
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:23:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:23:03 [DEBUG   ] spawn_process: at 2019-01-20 17:23:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:23:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:23:24 [DEBUG   ] Got command RPT from MCS: ref #1230072
2019-01-20 17:23:24 [DEBUG   ] summary = ERROR
2019-01-20 17:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230072  13 58503 62604801 A  ERRORERROR'
2019-01-20 17:23:25 [DEBUG   ] Got command RPT from MCS: ref #1230073
2019-01-20 17:23:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230073  77 58503 62605005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:23:25 [DEBUG   ] Got command RPT from MCS: ref #1230074
2019-01-20 17:23:25 [DEBUG   ] summary = ERROR
2019-01-20 17:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230074  13 58503 62605209 A  ERRORERROR'
2019-01-20 17:23:25 [DEBUG   ] Got command RPT from MCS: ref #1230075
2019-01-20 17:23:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230075  77 58503 62605401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:23:25 [DEBUG   ] Got command RPT from MCS: ref #1230076
2019-01-20 17:23:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 17:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230076  12 58503 62605605 A  ERRORB¢ff'
2019-01-20 17:23:34 [DEBUG   ] Got command BAM from MCS: ref #1230077
2019-01-20 17:23:34 [INFO    ] Finished processing BAM request
2019-01-20 17:23:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230077   8 58503 62614049 A  ERROR'
2019-01-20 17:23:34 [DEBUG   ] Got command BAM from MCS: ref #1230078
2019-01-20 17:23:34 [INFO    ] Finished processing BAM request
2019-01-20 17:23:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230078   8 58503 62614053 A  ERROR'
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:23:34 [DEBUG   ] spawn_process: at 2019-01-20 17:23:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:23:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:23:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:24:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:24:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:24:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:24:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:24:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:24:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:24:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:24:02 [DEBUG   ] Finished updating board flags in 1.934 seconds
2019-01-20 17:24:05 [DEBUG   ] Got command BAM from MCS: ref #1230079
2019-01-20 17:24:05 [INFO    ] Finished processing BAM request
2019-01-20 17:24:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230079   8 58503 62645025 A  ERROR'
2019-01-20 17:24:05 [DEBUG   ] Got command BAM from MCS: ref #1230080
2019-01-20 17:24:05 [INFO    ] Finished processing BAM request
2019-01-20 17:24:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230080   8 58503 62645029 A  ERROR'
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:24:05 [DEBUG   ] spawn_process: at 2019-01-20 17:24:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:24:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:24:36 [DEBUG   ] Got command BAM from MCS: ref #1230081
2019-01-20 17:24:36 [INFO    ] Finished processing BAM request
2019-01-20 17:24:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:24:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230081   8 58503 62676033 A  ERROR'
2019-01-20 17:24:36 [DEBUG   ] Got command BAM from MCS: ref #1230082
2019-01-20 17:24:36 [INFO    ] Finished processing BAM request
2019-01-20 17:24:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:24:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230082   8 58503 62676037 A  ERROR'
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:24:36 [DEBUG   ] spawn_process: at 2019-01-20 17:24:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:24:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:24:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:25:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:25:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:25:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:25:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:25:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:25:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:25:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:25:01 [DEBUG   ] Finished updating board flags in 1.258 seconds
2019-01-20 17:25:07 [DEBUG   ] Got command BAM from MCS: ref #1230084
2019-01-20 17:25:07 [INFO    ] Finished processing BAM request
2019-01-20 17:25:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230084   8 58503 62707033 A  ERROR'
2019-01-20 17:25:07 [DEBUG   ] Got command BAM from MCS: ref #1230083
2019-01-20 17:25:07 [INFO    ] Finished processing BAM request
2019-01-20 17:25:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230083   8 58503 62707037 A  ERROR'
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:25:07 [DEBUG   ] spawn_process: at 2019-01-20 17:25:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:25:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:25:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:25:38 [DEBUG   ] Got command BAM from MCS: ref #1230090
2019-01-20 17:25:38 [INFO    ] Finished processing BAM request
2019-01-20 17:25:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:25:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230090   8 58503 62738029 A  ERROR'
2019-01-20 17:25:38 [DEBUG   ] Got command BAM from MCS: ref #1230089
2019-01-20 17:25:38 [INFO    ] Finished processing BAM request
2019-01-20 17:25:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:25:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230089   8 58503 62738033 A  ERROR'
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:25:38 [DEBUG   ] spawn_process: at 2019-01-20 17:25:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:25:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:26:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:26:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:26:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 17:26:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:26:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:26:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:26:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:26:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:26:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:26:01 [DEBUG   ] Finished updating board flags in 1.222 seconds
2019-01-20 17:26:06 [DEBUG   ] Got command RPT from MCS: ref #1230091
2019-01-20 17:26:06 [DEBUG   ] summary = ERROR
2019-01-20 17:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230091  13 58503 62766709 A  ERRORERROR'
2019-01-20 17:26:06 [DEBUG   ] Got command RPT from MCS: ref #1230092
2019-01-20 17:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230092  77 58503 62766710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:26:09 [DEBUG   ] Got command BAM from MCS: ref #1230109
2019-01-20 17:26:09 [INFO    ] Finished processing BAM request
2019-01-20 17:26:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230109   8 58503 62769033 A  ERROR'
2019-01-20 17:26:09 [DEBUG   ] Got command BAM from MCS: ref #1230108
2019-01-20 17:26:09 [INFO    ] Finished processing BAM request
2019-01-20 17:26:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230108   8 58503 62769037 A  ERROR'
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:26:09 [DEBUG   ] spawn_process: at 2019-01-20 17:26:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:26:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:26:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:26:40 [DEBUG   ] Got command BAM from MCS: ref #1230110
2019-01-20 17:26:40 [INFO    ] Finished processing BAM request
2019-01-20 17:26:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230110   8 58503 62800033 A  ERROR'
2019-01-20 17:26:40 [DEBUG   ] Got command BAM from MCS: ref #1230111
2019-01-20 17:26:40 [INFO    ] Finished processing BAM request
2019-01-20 17:26:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230111   8 58503 62800037 A  ERROR'
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:26:40 [DEBUG   ] spawn_process: at 2019-01-20 17:26:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:26:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:27:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:27:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:27:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:27:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:27:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:27:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:27:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:27:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:27:01 [DEBUG   ] Finished updating board flags in 1.174 seconds
2019-01-20 17:27:11 [DEBUG   ] Got command BAM from MCS: ref #1230113
2019-01-20 17:27:11 [INFO    ] Finished processing BAM request
2019-01-20 17:27:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230113   8 58503 62831033 A  ERROR'
2019-01-20 17:27:11 [DEBUG   ] Got command BAM from MCS: ref #1230112
2019-01-20 17:27:11 [INFO    ] Finished processing BAM request
2019-01-20 17:27:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230112   8 58503 62831037 A  ERROR'
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:27:11 [DEBUG   ] spawn_process: at 2019-01-20 17:27:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:27:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:27:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:27:42 [DEBUG   ] Got command BAM from MCS: ref #1230115
2019-01-20 17:27:42 [INFO    ] Finished processing BAM request
2019-01-20 17:27:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:27:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230115   8 58503 62862025 A  ERROR'
2019-01-20 17:27:42 [DEBUG   ] Got command BAM from MCS: ref #1230114
2019-01-20 17:27:42 [INFO    ] Finished processing BAM request
2019-01-20 17:27:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:27:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230114   8 58503 62862029 A  ERROR'
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:27:42 [DEBUG   ] spawn_process: at 2019-01-20 17:27:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:27:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:28:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:28:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 17:28:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:28:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:28:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:28:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:28:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:28:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:28:01 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-01-20 17:28:13 [DEBUG   ] Got command BAM from MCS: ref #1230119
2019-01-20 17:28:13 [INFO    ] Finished processing BAM request
2019-01-20 17:28:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:28:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230119   8 58503 62893025 A  ERROR'
2019-01-20 17:28:13 [DEBUG   ] Got command BAM from MCS: ref #1230118
2019-01-20 17:28:13 [INFO    ] Finished processing BAM request
2019-01-20 17:28:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:28:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230118   8 58503 62893029 A  ERROR'
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:28:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:28:13 [DEBUG   ] spawn_process: at 2019-01-20 17:28:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:28:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 17:28:24 [DEBUG   ] Got command RPT from MCS: ref #1230120
2019-01-20 17:28:24 [DEBUG   ] summary = ERROR
2019-01-20 17:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230120  13 58503 62904889 A  ERRORERROR'
2019-01-20 17:28:25 [DEBUG   ] Got command RPT from MCS: ref #1230121
2019-01-20 17:28:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230121  77 58503 62905093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:28:25 [DEBUG   ] Got command RPT from MCS: ref #1230122
2019-01-20 17:28:25 [DEBUG   ] summary = ERROR
2019-01-20 17:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230122  13 58503 62905285 A  ERRORERROR'
2019-01-20 17:28:25 [DEBUG   ] Got command RPT from MCS: ref #1230124
2019-01-20 17:28:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230124  77 58503 62905489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:28:25 [DEBUG   ] Got command RPT from MCS: ref #1230126
2019-01-20 17:28:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 17:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230126  12 58503 62905693 A  ERRORB¢ff'
2019-01-20 17:28:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:28:44 [DEBUG   ] Got command BAM from MCS: ref #1230135
2019-01-20 17:28:44 [INFO    ] Finished processing BAM request
2019-01-20 17:28:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230135   8 58503 62924033 A  ERROR'
2019-01-20 17:28:44 [DEBUG   ] Got command BAM from MCS: ref #1230134
2019-01-20 17:28:44 [INFO    ] Finished processing BAM request
2019-01-20 17:28:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230134   8 58503 62924037 A  ERROR'
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:28:44 [DEBUG   ] spawn_process: at 2019-01-20 17:28:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:28:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:29:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 17:29:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:29:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:29:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:29:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:29:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:29:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:29:01 [WARNING ] (13, 1, 'bot')
2019-01-20 17:29:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:29:01 [DEBUG   ] Finished updating board flags in 0.971 seconds
2019-01-20 17:29:15 [DEBUG   ] Got command BAM from MCS: ref #1230136
2019-01-20 17:29:15 [INFO    ] Finished processing BAM request
2019-01-20 17:29:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230136   8 58503 62955029 A  ERROR'
2019-01-20 17:29:15 [DEBUG   ] Got command BAM from MCS: ref #1230137
2019-01-20 17:29:15 [INFO    ] Finished processing BAM request
2019-01-20 17:29:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230137   8 58503 62955033 A  ERROR'
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:29:15 [DEBUG   ] spawn_process: at 2019-01-20 17:29:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:29:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:29:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:29:46 [DEBUG   ] Got command BAM from MCS: ref #1230138
2019-01-20 17:29:46 [INFO    ] Finished processing BAM request
2019-01-20 17:29:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:29:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230138   8 58503 62986029 A  ERROR'
2019-01-20 17:29:46 [DEBUG   ] Got command BAM from MCS: ref #1230139
2019-01-20 17:29:46 [INFO    ] Finished processing BAM request
2019-01-20 17:29:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:29:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230139   8 58503 62986033 A  ERROR'
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:29:46 [DEBUG   ] spawn_process: at 2019-01-20 17:29:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:29:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:30:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 17:30:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:30:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:30:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:30:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:30:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:30:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:30:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:30:02 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-20 17:30:17 [DEBUG   ] Got command BAM from MCS: ref #1230140
2019-01-20 17:30:17 [INFO    ] Finished processing BAM request
2019-01-20 17:30:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:30:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230140   8 58503 63017029 A  ERROR'
2019-01-20 17:30:17 [DEBUG   ] Got command BAM from MCS: ref #1230141
2019-01-20 17:30:17 [INFO    ] Finished processing BAM request
2019-01-20 17:30:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:30:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230141   8 58503 63017033 A  ERROR'
2019-01-20 17:30:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:30:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:30:17 [DEBUG   ] spawn_process: at 2019-01-20 17:30:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:30:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 17:30:48 [DEBUG   ] Got command BAM from MCS: ref #1230143
2019-01-20 17:30:48 [INFO    ] Finished processing BAM request
2019-01-20 17:30:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230143   8 58503 63048029 A  ERROR'
2019-01-20 17:30:48 [DEBUG   ] Got command BAM from MCS: ref #1230142
2019-01-20 17:30:48 [INFO    ] Finished processing BAM request
2019-01-20 17:30:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230142   8 58503 63048033 A  ERROR'
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:30:48 [DEBUG   ] spawn_process: at 2019-01-20 17:30:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:30:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:31:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 4
2019-01-20 17:31:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:31:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:31:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 17:31:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:31:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:31:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:31:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:31:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:31:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:31:02 [DEBUG   ] Finished updating board flags in 1.194 seconds
2019-01-20 17:31:06 [DEBUG   ] Got command RPT from MCS: ref #1230144
2019-01-20 17:31:06 [DEBUG   ] summary = ERROR
2019-01-20 17:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230144  13 58503 63066701 A  ERRORERROR'
2019-01-20 17:31:06 [DEBUG   ] Got command RPT from MCS: ref #1230145
2019-01-20 17:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230145  77 58503 63066702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:31:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:31:19 [DEBUG   ] Got command BAM from MCS: ref #1230162
2019-01-20 17:31:19 [INFO    ] Finished processing BAM request
2019-01-20 17:31:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:31:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230162   8 58503 63079025 A  ERROR'
2019-01-20 17:31:19 [DEBUG   ] Got command BAM from MCS: ref #1230161
2019-01-20 17:31:19 [INFO    ] Finished processing BAM request
2019-01-20 17:31:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:31:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230161   8 58503 63079029 A  ERROR'
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:31:19 [DEBUG   ] spawn_process: at 2019-01-20 17:31:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:31:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:31:50 [DEBUG   ] Got command BAM from MCS: ref #1230167
2019-01-20 17:31:50 [INFO    ] Finished processing BAM request
2019-01-20 17:31:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230167   8 58503 63110037 A  ERROR'
2019-01-20 17:31:50 [DEBUG   ] Got command BAM from MCS: ref #1230168
2019-01-20 17:31:50 [INFO    ] Finished processing BAM request
2019-01-20 17:31:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230168   8 58503 63110045 A  ERROR'
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:31:50 [DEBUG   ] spawn_process: at 2019-01-20 17:31:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:31:51 [DEBUG   ] spawn_process: at 2019-01-20 17:31:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:31:51 [DEBUG   ] spawn_process: at 2019-01-20 17:31:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:31:51 [DEBUG   ] spawn_process: at 2019-01-20 17:31:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:31:51 [DEBUG   ] spawn_process: at 2019-01-20 17:31:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:31:51 [DEBUG   ] spawn_process: at 2019-01-20 17:31:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:31:51 [DEBUG   ] spawn_process: at 2019-01-20 17:31:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:31:51 [DEBUG   ] spawn_process: at 2019-01-20 17:31:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:31:51 [DEBUG   ] spawn_process: at 2019-01-20 17:31:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:31:51 [DEBUG   ] spawn_process: at 2019-01-20 17:31:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:31:51 [DEBUG   ] spawn_process: at 2019-01-20 17:31:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:31:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:32:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 17:32:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:32:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:32:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:32:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:32:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:32:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:32:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:32:02 [DEBUG   ] Finished updating board flags in 1.002 seconds
2019-01-20 17:32:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:32:21 [DEBUG   ] Got command BAM from MCS: ref #1230169
2019-01-20 17:32:21 [INFO    ] Finished processing BAM request
2019-01-20 17:32:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230169   8 58503 63141029 A  ERROR'
2019-01-20 17:32:21 [DEBUG   ] Got command BAM from MCS: ref #1230170
2019-01-20 17:32:21 [INFO    ] Finished processing BAM request
2019-01-20 17:32:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230170   8 58503 63141033 A  ERROR'
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:32:21 [DEBUG   ] spawn_process: at 2019-01-20 17:32:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:32:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:32:52 [DEBUG   ] Got command BAM from MCS: ref #1230171
2019-01-20 17:32:52 [INFO    ] Finished processing BAM request
2019-01-20 17:32:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:32:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230171   8 58503 63172033 A  ERROR'
2019-01-20 17:32:52 [DEBUG   ] Got command BAM from MCS: ref #1230172
2019-01-20 17:32:52 [INFO    ] Finished processing BAM request
2019-01-20 17:32:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:32:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230172   8 58503 63172037 A  ERROR'
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:32:52 [DEBUG   ] spawn_process: at 2019-01-20 17:32:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:32:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:33:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:33:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:33:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:33:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:33:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:33:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:33:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:33:02 [DEBUG   ] Finished updating board flags in 0.993 seconds
2019-01-20 17:33:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:33:23 [DEBUG   ] Got command BAM from MCS: ref #1230174
2019-01-20 17:33:23 [INFO    ] Finished processing BAM request
2019-01-20 17:33:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230174   8 58503 63203033 A  ERROR'
2019-01-20 17:33:23 [DEBUG   ] Got command BAM from MCS: ref #1230173
2019-01-20 17:33:23 [INFO    ] Finished processing BAM request
2019-01-20 17:33:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230173   8 58503 63203041 A  ERROR'
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:33:23 [DEBUG   ] spawn_process: at 2019-01-20 17:33:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:33:24 [DEBUG   ] Got command RPT from MCS: ref #1230175
2019-01-20 17:33:24 [DEBUG   ] summary = ERROR
2019-01-20 17:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230175  13 58503 63204969 A  ERRORERROR'
2019-01-20 17:33:25 [DEBUG   ] Got command RPT from MCS: ref #1230176
2019-01-20 17:33:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230176  77 58503 63205173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:33:25 [DEBUG   ] Got command RPT from MCS: ref #1230177
2019-01-20 17:33:25 [DEBUG   ] summary = ERROR
2019-01-20 17:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230177  13 58503 63205377 A  ERRORERROR'
2019-01-20 17:33:25 [DEBUG   ] Got command RPT from MCS: ref #1230178
2019-01-20 17:33:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230178  77 58503 63205569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:33:25 [DEBUG   ] Got command RPT from MCS: ref #1230179
2019-01-20 17:33:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 17:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230179  12 58503 63205773 A  ERRORB£ff'
2019-01-20 17:33:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:33:54 [DEBUG   ] Got command BAM from MCS: ref #1230180
2019-01-20 17:33:54 [INFO    ] Finished processing BAM request
2019-01-20 17:33:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230180   8 58503 63234033 A  ERROR'
2019-01-20 17:33:54 [DEBUG   ] Got command BAM from MCS: ref #1230181
2019-01-20 17:33:54 [INFO    ] Finished processing BAM request
2019-01-20 17:33:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230181   8 58503 63234037 A  ERROR'
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:33:54 [DEBUG   ] spawn_process: at 2019-01-20 17:33:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:33:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:34:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:34:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:34:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:34:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:34:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:34:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:34:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:34:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:34:02 [DEBUG   ] Finished updating board flags in 1.253 seconds
2019-01-20 17:34:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:34:25 [DEBUG   ] Got command BAM from MCS: ref #1230183
2019-01-20 17:34:25 [INFO    ] Finished processing BAM request
2019-01-20 17:34:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:34:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230183   8 58503 63265033 A  ERROR'
2019-01-20 17:34:25 [DEBUG   ] Got command BAM from MCS: ref #1230182
2019-01-20 17:34:25 [INFO    ] Finished processing BAM request
2019-01-20 17:34:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:34:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230182   8 58503 63265037 A  ERROR'
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:34:25 [DEBUG   ] spawn_process: at 2019-01-20 17:34:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:34:26 [DEBUG   ] spawn_process: at 2019-01-20 17:34:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:34:26 [DEBUG   ] spawn_process: at 2019-01-20 17:34:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:34:26 [DEBUG   ] spawn_process: at 2019-01-20 17:34:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:34:26 [DEBUG   ] spawn_process: at 2019-01-20 17:34:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:34:26 [DEBUG   ] spawn_process: at 2019-01-20 17:34:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:34:26 [DEBUG   ] spawn_process: at 2019-01-20 17:34:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:34:26 [DEBUG   ] spawn_process: at 2019-01-20 17:34:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:34:26 [DEBUG   ] spawn_process: at 2019-01-20 17:34:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:34:26 [DEBUG   ] spawn_process: at 2019-01-20 17:34:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:34:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:34:26 [DEBUG   ] spawn_process: at 2019-01-20 17:34:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:34:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:34:56 [DEBUG   ] Got command BAM from MCS: ref #1230189
2019-01-20 17:34:56 [INFO    ] Finished processing BAM request
2019-01-20 17:34:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230189   8 58503 63296029 A  ERROR'
2019-01-20 17:34:56 [DEBUG   ] Got command BAM from MCS: ref #1230188
2019-01-20 17:34:56 [INFO    ] Finished processing BAM request
2019-01-20 17:34:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230188   8 58503 63296033 A  ERROR'
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:34:56 [DEBUG   ] spawn_process: at 2019-01-20 17:34:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:34:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:35:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 17:35:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 17:35:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:35:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:35:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:35:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:35:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:35:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:35:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:35:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:35:02 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-01-20 17:35:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:35:27 [DEBUG   ] Got command BAM from MCS: ref #1230191
2019-01-20 17:35:27 [INFO    ] Finished processing BAM request
2019-01-20 17:35:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:35:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230191   8 58503 63327025 A  ERROR'
2019-01-20 17:35:27 [DEBUG   ] Got command BAM from MCS: ref #1230190
2019-01-20 17:35:27 [INFO    ] Finished processing BAM request
2019-01-20 17:35:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:35:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230190   8 58503 63327029 A  ERROR'
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:35:27 [DEBUG   ] spawn_process: at 2019-01-20 17:35:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:35:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:35:57 [DEBUG   ] Got command BAM from MCS: ref #1230193
2019-01-20 17:35:57 [INFO    ] Finished processing BAM request
2019-01-20 17:35:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:35:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230193   8 58503 63357025 A  ERROR'
2019-01-20 17:35:57 [DEBUG   ] Got command BAM from MCS: ref #1230192
2019-01-20 17:35:57 [INFO    ] Finished processing BAM request
2019-01-20 17:35:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:35:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230192   8 58503 63357029 A  ERROR'
2019-01-20 17:35:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:35:57 [DEBUG   ] spawn_process: at 2019-01-20 17:35:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:36:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:36:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:36:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 17:36:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:36:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:36:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:36:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:36:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:36:03 [DEBUG   ] Finished updating board flags in 1.752 seconds
2019-01-20 17:36:06 [DEBUG   ] Got command RPT from MCS: ref #1230194
2019-01-20 17:36:06 [DEBUG   ] summary = ERROR
2019-01-20 17:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230194  13 58503 63366713 A  ERRORERROR'
2019-01-20 17:36:06 [DEBUG   ] Got command RPT from MCS: ref #1230195
2019-01-20 17:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230195  77 58503 63366714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:36:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:36:27 [DEBUG   ] Got command BAM from MCS: ref #1230212
2019-01-20 17:36:27 [INFO    ] Finished processing BAM request
2019-01-20 17:36:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:36:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230212   8 58503 63387025 A  ERROR'
2019-01-20 17:36:27 [DEBUG   ] Got command BAM from MCS: ref #1230211
2019-01-20 17:36:27 [INFO    ] Finished processing BAM request
2019-01-20 17:36:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:36:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230211   8 58503 63387029 A  ERROR'
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:36:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:36:27 [DEBUG   ] spawn_process: at 2019-01-20 17:36:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:36:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:36:57 [DEBUG   ] Got command BAM from MCS: ref #1230214
2019-01-20 17:36:57 [INFO    ] Finished processing BAM request
2019-01-20 17:36:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:36:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230214   8 58503 63417025 A  ERROR'
2019-01-20 17:36:57 [DEBUG   ] Got command BAM from MCS: ref #1230213
2019-01-20 17:36:57 [INFO    ] Finished processing BAM request
2019-01-20 17:36:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:36:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230213   8 58503 63417029 A  ERROR'
2019-01-20 17:36:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:36:57 [DEBUG   ] spawn_process: at 2019-01-20 17:36:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:37:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:37:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:37:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:37:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:37:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:37:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:37:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:37:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:37:02 [DEBUG   ] Finished updating board flags in 1.049 seconds
2019-01-20 17:37:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:37:27 [DEBUG   ] Got command BAM from MCS: ref #1230216
2019-01-20 17:37:27 [INFO    ] Finished processing BAM request
2019-01-20 17:37:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:37:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230216   8 58503 63447029 A  ERROR'
2019-01-20 17:37:27 [DEBUG   ] Got command BAM from MCS: ref #1230215
2019-01-20 17:37:27 [INFO    ] Finished processing BAM request
2019-01-20 17:37:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:37:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230215   8 58503 63447033 A  ERROR'
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:37:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:37:27 [DEBUG   ] spawn_process: at 2019-01-20 17:37:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:37:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:37:57 [DEBUG   ] Got command BAM from MCS: ref #1230222
2019-01-20 17:37:57 [INFO    ] Finished processing BAM request
2019-01-20 17:37:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:37:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230222   8 58503 63477025 A  ERROR'
2019-01-20 17:37:57 [DEBUG   ] Got command BAM from MCS: ref #1230221
2019-01-20 17:37:57 [INFO    ] Finished processing BAM request
2019-01-20 17:37:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:37:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230221   8 58503 63477029 A  ERROR'
2019-01-20 17:37:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:37:57 [DEBUG   ] spawn_process: at 2019-01-20 17:37:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:38:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 17:38:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:38:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:38:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 17:38:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:38:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:38:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:38:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:38:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:38:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:38:02 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-01-20 17:38:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:38:25 [DEBUG   ] Got command RPT from MCS: ref #1230225
2019-01-20 17:38:25 [DEBUG   ] summary = ERROR
2019-01-20 17:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230225  13 58503 63505053 A  ERRORERROR'
2019-01-20 17:38:25 [DEBUG   ] Got command RPT from MCS: ref #1230226
2019-01-20 17:38:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230226  77 58503 63505257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:38:25 [DEBUG   ] Got command RPT from MCS: ref #1230227
2019-01-20 17:38:25 [DEBUG   ] summary = ERROR
2019-01-20 17:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230227  13 58503 63505461 A  ERRORERROR'
2019-01-20 17:38:25 [DEBUG   ] Got command RPT from MCS: ref #1230229
2019-01-20 17:38:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230229  77 58503 63505653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:38:25 [DEBUG   ] Got command RPT from MCS: ref #1230230
2019-01-20 17:38:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 17:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230230  12 58503 63505857 A  ERRORB£ff'
2019-01-20 17:38:27 [DEBUG   ] Got command BAM from MCS: ref #1230233
2019-01-20 17:38:27 [INFO    ] Finished processing BAM request
2019-01-20 17:38:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230233   8 58503 63507025 A  ERROR'
2019-01-20 17:38:27 [DEBUG   ] Got command BAM from MCS: ref #1230232
2019-01-20 17:38:27 [INFO    ] Finished processing BAM request
2019-01-20 17:38:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230232   8 58503 63507029 A  ERROR'
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:38:27 [DEBUG   ] spawn_process: at 2019-01-20 17:38:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:38:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:38:57 [DEBUG   ] Got command BAM from MCS: ref #1230237
2019-01-20 17:38:57 [INFO    ] Finished processing BAM request
2019-01-20 17:38:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230237   8 58503 63537029 A  ERROR'
2019-01-20 17:38:57 [DEBUG   ] Got command BAM from MCS: ref #1230238
2019-01-20 17:38:57 [INFO    ] Finished processing BAM request
2019-01-20 17:38:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230238   8 58503 63537033 A  ERROR'
2019-01-20 17:38:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:38:57 [DEBUG   ] spawn_process: at 2019-01-20 17:38:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:39:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 17:39:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 17:39:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:39:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:39:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:39:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:39:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:39:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:39:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:39:02 [DEBUG   ] Finished updating board flags in 1.012 seconds
2019-01-20 17:39:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:39:27 [DEBUG   ] Got command BAM from MCS: ref #1230240
2019-01-20 17:39:27 [INFO    ] Finished processing BAM request
2019-01-20 17:39:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:39:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230240   8 58503 63567033 A  ERROR'
2019-01-20 17:39:27 [DEBUG   ] Got command BAM from MCS: ref #1230239
2019-01-20 17:39:27 [INFO    ] Finished processing BAM request
2019-01-20 17:39:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:39:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230239   8 58503 63567037 A  ERROR'
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:39:27 [DEBUG   ] spawn_process: at 2019-01-20 17:39:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:39:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:39:57 [DEBUG   ] Got command BAM from MCS: ref #1230242
2019-01-20 17:39:57 [INFO    ] Finished processing BAM request
2019-01-20 17:39:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230242   8 58503 63597025 A  ERROR'
2019-01-20 17:39:57 [DEBUG   ] Got command BAM from MCS: ref #1230241
2019-01-20 17:39:57 [INFO    ] Finished processing BAM request
2019-01-20 17:39:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230241   8 58503 63597029 A  ERROR'
2019-01-20 17:39:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:39:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:39:57 [DEBUG   ] spawn_process: at 2019-01-20 17:39:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:40:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:40:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:40:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:40:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:40:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:40:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:40:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:40:03 [DEBUG   ] Finished updating board flags in 1.602 seconds
2019-01-20 17:40:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:40:27 [DEBUG   ] Got command BAM from MCS: ref #1230244
2019-01-20 17:40:27 [INFO    ] Finished processing BAM request
2019-01-20 17:40:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:40:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230244   8 58503 63627025 A  ERROR'
2019-01-20 17:40:27 [DEBUG   ] Got command BAM from MCS: ref #1230243
2019-01-20 17:40:27 [INFO    ] Finished processing BAM request
2019-01-20 17:40:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:40:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230243   8 58503 63627029 A  ERROR'
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:40:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:40:27 [DEBUG   ] spawn_process: at 2019-01-20 17:40:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:40:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:40:57 [DEBUG   ] Got command BAM from MCS: ref #1230249
2019-01-20 17:40:57 [INFO    ] Finished processing BAM request
2019-01-20 17:40:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:40:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230249   8 58503 63657025 A  ERROR'
2019-01-20 17:40:57 [DEBUG   ] Got command BAM from MCS: ref #1230250
2019-01-20 17:40:57 [INFO    ] Finished processing BAM request
2019-01-20 17:40:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:40:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230250   8 58503 63657029 A  ERROR'
2019-01-20 17:40:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:40:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:40:57 [DEBUG   ] spawn_process: at 2019-01-20 17:40:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:41:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:41:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 17:41:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:41:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:41:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:41:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:41:02 [WARNING ] (13, 1, 'bot')
2019-01-20 17:41:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:41:02 [DEBUG   ] Finished updating board flags in 0.968 seconds
2019-01-20 17:41:06 [DEBUG   ] Got command RPT from MCS: ref #1230251
2019-01-20 17:41:06 [DEBUG   ] summary = ERROR
2019-01-20 17:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230251  13 58503 63666713 A  ERRORERROR'
2019-01-20 17:41:06 [DEBUG   ] Got command RPT from MCS: ref #1230252
2019-01-20 17:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230252  77 58503 63666714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:41:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:41:27 [DEBUG   ] Got command BAM from MCS: ref #1230269
2019-01-20 17:41:27 [INFO    ] Finished processing BAM request
2019-01-20 17:41:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230269   8 58503 63687025 A  ERROR'
2019-01-20 17:41:27 [DEBUG   ] Got command BAM from MCS: ref #1230268
2019-01-20 17:41:27 [INFO    ] Finished processing BAM request
2019-01-20 17:41:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230268   8 58503 63687029 A  ERROR'
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:41:27 [DEBUG   ] spawn_process: at 2019-01-20 17:41:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:41:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:41:57 [DEBUG   ] Got command BAM from MCS: ref #1230271
2019-01-20 17:41:57 [INFO    ] Finished processing BAM request
2019-01-20 17:41:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:41:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230271   8 58503 63717025 A  ERROR'
2019-01-20 17:41:57 [DEBUG   ] Got command BAM from MCS: ref #1230270
2019-01-20 17:41:57 [INFO    ] Finished processing BAM request
2019-01-20 17:41:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:41:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230270   8 58503 63717029 A  ERROR'
2019-01-20 17:41:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:41:57 [DEBUG   ] spawn_process: at 2019-01-20 17:41:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:42:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:42:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:42:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:42:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:42:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:42:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:42:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:42:03 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-01-20 17:42:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:42:27 [DEBUG   ] Got command BAM from MCS: ref #1230272
2019-01-20 17:42:27 [INFO    ] Finished processing BAM request
2019-01-20 17:42:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230272   8 58503 63747025 A  ERROR'
2019-01-20 17:42:27 [DEBUG   ] Got command BAM from MCS: ref #1230273
2019-01-20 17:42:27 [INFO    ] Finished processing BAM request
2019-01-20 17:42:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230273   8 58503 63747029 A  ERROR'
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:42:27 [DEBUG   ] spawn_process: at 2019-01-20 17:42:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:42:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:42:57 [DEBUG   ] Got command BAM from MCS: ref #1230275
2019-01-20 17:42:57 [INFO    ] Finished processing BAM request
2019-01-20 17:42:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:42:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230275   8 58503 63777029 A  ERROR'
2019-01-20 17:42:57 [DEBUG   ] Got command BAM from MCS: ref #1230274
2019-01-20 17:42:57 [INFO    ] Finished processing BAM request
2019-01-20 17:42:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:42:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230274   8 58503 63777033 A  ERROR'
2019-01-20 17:42:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:42:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:42:57 [DEBUG   ] spawn_process: at 2019-01-20 17:42:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:43:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 17:43:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-20 17:43:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:43:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 17:43:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:43:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:43:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:43:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:43:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:43:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:43:03 [DEBUG   ] Finished updating board flags in 1.197 seconds
2019-01-20 17:43:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:43:25 [DEBUG   ] Got command RPT from MCS: ref #1230276
2019-01-20 17:43:25 [DEBUG   ] summary = ERROR
2019-01-20 17:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230276  13 58503 63805145 A  ERRORERROR'
2019-01-20 17:43:25 [DEBUG   ] Got command RPT from MCS: ref #1230277
2019-01-20 17:43:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230277  77 58503 63805337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:43:25 [DEBUG   ] Got command RPT from MCS: ref #1230278
2019-01-20 17:43:25 [DEBUG   ] summary = ERROR
2019-01-20 17:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230278  13 58503 63805541 A  ERRORERROR'
2019-01-20 17:43:25 [DEBUG   ] Got command RPT from MCS: ref #1230279
2019-01-20 17:43:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230279  77 58503 63805745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:43:25 [DEBUG   ] Got command RPT from MCS: ref #1230280
2019-01-20 17:43:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 17:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230280  12 58503 63805937 A  ERRORB¢ff'
2019-01-20 17:43:27 [DEBUG   ] Got command BAM from MCS: ref #1230282
2019-01-20 17:43:27 [INFO    ] Finished processing BAM request
2019-01-20 17:43:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230282   8 58503 63807033 A  ERROR'
2019-01-20 17:43:27 [DEBUG   ] Got command BAM from MCS: ref #1230281
2019-01-20 17:43:27 [INFO    ] Finished processing BAM request
2019-01-20 17:43:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230281   8 58503 63807037 A  ERROR'
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:43:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:43:27 [DEBUG   ] spawn_process: at 2019-01-20 17:43:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:43:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:43:57 [DEBUG   ] Got command BAM from MCS: ref #1230288
2019-01-20 17:43:57 [INFO    ] Finished processing BAM request
2019-01-20 17:43:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:43:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230288   8 58503 63837033 A  ERROR'
2019-01-20 17:43:57 [DEBUG   ] Got command BAM from MCS: ref #1230287
2019-01-20 17:43:57 [INFO    ] Finished processing BAM request
2019-01-20 17:43:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:43:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230287   8 58503 63837041 A  ERROR'
2019-01-20 17:43:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:43:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:43:57 [DEBUG   ] spawn_process: at 2019-01-20 17:43:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:44:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 17:44:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:44:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 17:44:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:44:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:44:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:44:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:44:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:44:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:44:03 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-01-20 17:44:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:44:27 [DEBUG   ] Got command BAM from MCS: ref #1230290
2019-01-20 17:44:27 [INFO    ] Finished processing BAM request
2019-01-20 17:44:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:44:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230290   8 58503 63867033 A  ERROR'
2019-01-20 17:44:27 [DEBUG   ] Got command BAM from MCS: ref #1230289
2019-01-20 17:44:27 [INFO    ] Finished processing BAM request
2019-01-20 17:44:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:44:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230289   8 58503 63867037 A  ERROR'
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:44:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:44:27 [DEBUG   ] spawn_process: at 2019-01-20 17:44:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:44:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:44:57 [DEBUG   ] Got command BAM from MCS: ref #1230292
2019-01-20 17:44:57 [INFO    ] Finished processing BAM request
2019-01-20 17:44:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230292   8 58503 63897029 A  ERROR'
2019-01-20 17:44:57 [DEBUG   ] Got command BAM from MCS: ref #1230291
2019-01-20 17:44:57 [INFO    ] Finished processing BAM request
2019-01-20 17:44:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230291   8 58503 63897033 A  ERROR'
2019-01-20 17:44:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:44:57 [DEBUG   ] spawn_process: at 2019-01-20 17:44:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:45:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:45:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:45:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:45:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:45:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:45:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:45:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:45:03 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-20 17:45:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 17:45:27 [DEBUG   ] Got command BAM from MCS: ref #1230293
2019-01-20 17:45:27 [INFO    ] Finished processing BAM request
2019-01-20 17:45:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230293   8 58503 63927025 A  ERROR'
2019-01-20 17:45:27 [DEBUG   ] Got command BAM from MCS: ref #1230294
2019-01-20 17:45:27 [INFO    ] Finished processing BAM request
2019-01-20 17:45:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230294   8 58503 63927029 A  ERROR'
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:45:27 [DEBUG   ] spawn_process: at 2019-01-20 17:45:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:45:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:45:57 [DEBUG   ] Got command BAM from MCS: ref #1230295
2019-01-20 17:45:57 [INFO    ] Finished processing BAM request
2019-01-20 17:45:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:45:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230295   8 58503 63957029 A  ERROR'
2019-01-20 17:45:57 [DEBUG   ] Got command BAM from MCS: ref #1230296
2019-01-20 17:45:57 [INFO    ] Finished processing BAM request
2019-01-20 17:45:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:45:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230296   8 58503 63957033 A  ERROR'
2019-01-20 17:45:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:45:57 [DEBUG   ] spawn_process: at 2019-01-20 17:45:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:46:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:46:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 17:46:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:46:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:46:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:46:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:46:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:46:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:46:03 [DEBUG   ] Finished updating board flags in 0.984 seconds
2019-01-20 17:46:06 [DEBUG   ] Got command RPT from MCS: ref #1230297
2019-01-20 17:46:06 [DEBUG   ] summary = ERROR
2019-01-20 17:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230297  13 58503 63966705 A  ERRORERROR'
2019-01-20 17:46:06 [DEBUG   ] Got command RPT from MCS: ref #1230298
2019-01-20 17:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230298  77 58503 63966706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:46:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:46:27 [DEBUG   ] Got command BAM from MCS: ref #1230315
2019-01-20 17:46:27 [INFO    ] Finished processing BAM request
2019-01-20 17:46:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230315   8 58503 63987025 A  ERROR'
2019-01-20 17:46:27 [DEBUG   ] Got command BAM from MCS: ref #1230314
2019-01-20 17:46:27 [INFO    ] Finished processing BAM request
2019-01-20 17:46:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230314   8 58503 63987029 A  ERROR'
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:46:27 [DEBUG   ] spawn_process: at 2019-01-20 17:46:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:46:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:46:57 [DEBUG   ] Got command BAM from MCS: ref #1230320
2019-01-20 17:46:57 [INFO    ] Finished processing BAM request
2019-01-20 17:46:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:46:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230320   8 58503 64017029 A  ERROR'
2019-01-20 17:46:57 [DEBUG   ] Got command BAM from MCS: ref #1230321
2019-01-20 17:46:57 [INFO    ] Finished processing BAM request
2019-01-20 17:46:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:46:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230321   8 58503 64017033 A  ERROR'
2019-01-20 17:46:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:46:57 [DEBUG   ] spawn_process: at 2019-01-20 17:46:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:47:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:47:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:47:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:47:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:47:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:47:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:47:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:47:04 [DEBUG   ] Finished updating board flags in 1.856 seconds
2019-01-20 17:47:17 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-20 17:47:27 [DEBUG   ] Got command BAM from MCS: ref #1230322
2019-01-20 17:47:27 [INFO    ] Finished processing BAM request
2019-01-20 17:47:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:47:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230322   8 58503 64047029 A  ERROR'
2019-01-20 17:47:27 [DEBUG   ] Got command BAM from MCS: ref #1230323
2019-01-20 17:47:27 [INFO    ] Finished processing BAM request
2019-01-20 17:47:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:47:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230323   8 58503 64047033 A  ERROR'
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:47:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:47:27 [DEBUG   ] spawn_process: at 2019-01-20 17:47:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:47:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:47:57 [DEBUG   ] Got command BAM from MCS: ref #1230325
2019-01-20 17:47:57 [INFO    ] Finished processing BAM request
2019-01-20 17:47:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:47:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230325   8 58503 64077033 A  ERROR'
2019-01-20 17:47:57 [DEBUG   ] Got command BAM from MCS: ref #1230324
2019-01-20 17:47:57 [INFO    ] Finished processing BAM request
2019-01-20 17:47:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:47:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230324   8 58503 64077037 A  ERROR'
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:47:57 [DEBUG   ] spawn_process: at 2019-01-20 17:47:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:47:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:48:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 17:48:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 17:48:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 17:48:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-01-20 17:48:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:48:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 17:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 17:48:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:48:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:48:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:48:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:48:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:48:04 [DEBUG   ] Finished updating board flags in 1.754 seconds
2019-01-20 17:48:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:48:25 [DEBUG   ] Got command RPT from MCS: ref #1230328
2019-01-20 17:48:25 [DEBUG   ] summary = ERROR
2019-01-20 17:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230328  13 58503 64105221 A  ERRORERROR'
2019-01-20 17:48:25 [DEBUG   ] Got command RPT from MCS: ref #1230329
2019-01-20 17:48:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230329  77 58503 64105425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:48:25 [DEBUG   ] Got command RPT from MCS: ref #1230330
2019-01-20 17:48:25 [DEBUG   ] summary = ERROR
2019-01-20 17:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230330  13 58503 64105629 A  ERRORERROR'
2019-01-20 17:48:25 [DEBUG   ] Got command RPT from MCS: ref #1230332
2019-01-20 17:48:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230332  77 58503 64105821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:48:26 [DEBUG   ] Got command RPT from MCS: ref #1230333
2019-01-20 17:48:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 17:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230333  12 58503 64106025 A  ERRORB£ff'
2019-01-20 17:48:27 [DEBUG   ] Got command BAM from MCS: ref #1230336
2019-01-20 17:48:27 [INFO    ] Finished processing BAM request
2019-01-20 17:48:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230336   8 58503 64107025 A  ERROR'
2019-01-20 17:48:27 [DEBUG   ] Got command BAM from MCS: ref #1230335
2019-01-20 17:48:27 [INFO    ] Finished processing BAM request
2019-01-20 17:48:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230335   8 58503 64107029 A  ERROR'
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:48:27 [DEBUG   ] spawn_process: at 2019-01-20 17:48:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:48:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:48:57 [DEBUG   ] Got command BAM from MCS: ref #1230341
2019-01-20 17:48:57 [INFO    ] Finished processing BAM request
2019-01-20 17:48:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230341   8 58503 64137025 A  ERROR'
2019-01-20 17:48:57 [DEBUG   ] Got command BAM from MCS: ref #1230340
2019-01-20 17:48:57 [INFO    ] Finished processing BAM request
2019-01-20 17:48:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230340   8 58503 64137029 A  ERROR'
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:48:57 [DEBUG   ] spawn_process: at 2019-01-20 17:48:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:48:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 17:49:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 17:49:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:49:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:49:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 17:49:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:49:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 17:49:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 17:49:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:49:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:49:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:49:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:49:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:49:03 [DEBUG   ] Finished updating board flags in 1.045 seconds
2019-01-20 17:49:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 17:49:27 [DEBUG   ] Got command BAM from MCS: ref #1230343
2019-01-20 17:49:27 [INFO    ] Finished processing BAM request
2019-01-20 17:49:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:49:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230343   8 58503 64167025 A  ERROR'
2019-01-20 17:49:27 [DEBUG   ] Got command BAM from MCS: ref #1230342
2019-01-20 17:49:27 [INFO    ] Finished processing BAM request
2019-01-20 17:49:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:49:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230342   8 58503 64167029 A  ERROR'
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:49:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:49:27 [DEBUG   ] spawn_process: at 2019-01-20 17:49:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:49:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 17:49:57 [DEBUG   ] Got command BAM from MCS: ref #1230349
2019-01-20 17:49:57 [INFO    ] Finished processing BAM request
2019-01-20 17:49:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230349   8 58503 64197033 A  ERROR'
2019-01-20 17:49:57 [DEBUG   ] Got command BAM from MCS: ref #1230348
2019-01-20 17:49:57 [INFO    ] Finished processing BAM request
2019-01-20 17:49:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230348   8 58503 64197037 A  ERROR'
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:49:57 [DEBUG   ] spawn_process: at 2019-01-20 17:49:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:49:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 17:50:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:50:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 17:50:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:50:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:50:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:50:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:50:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:50:03 [DEBUG   ] Finished updating board flags in 1.022 seconds
2019-01-20 17:50:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 17:50:27 [DEBUG   ] Got command BAM from MCS: ref #1230351
2019-01-20 17:50:27 [INFO    ] Finished processing BAM request
2019-01-20 17:50:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:50:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230351   8 58503 64227029 A  ERROR'
2019-01-20 17:50:27 [DEBUG   ] Got command BAM from MCS: ref #1230350
2019-01-20 17:50:27 [INFO    ] Finished processing BAM request
2019-01-20 17:50:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:50:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230350   8 58503 64227033 A  ERROR'
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:50:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:50:27 [DEBUG   ] spawn_process: at 2019-01-20 17:50:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:50:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 17:50:57 [DEBUG   ] Got command BAM from MCS: ref #1230352
2019-01-20 17:50:57 [INFO    ] Finished processing BAM request
2019-01-20 17:50:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:50:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230352   8 58503 64257025 A  ERROR'
2019-01-20 17:50:57 [DEBUG   ] Got command BAM from MCS: ref #1230353
2019-01-20 17:50:57 [INFO    ] Finished processing BAM request
2019-01-20 17:50:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:50:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230353   8 58503 64257029 A  ERROR'
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:50:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:50:57 [DEBUG   ] spawn_process: at 2019-01-20 17:50:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:50:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 17:51:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:51:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 17:51:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-20 17:51:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:51:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 17:51:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 17:51:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:51:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:51:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:51:03 [WARNING ] (13, 1, 'bot')
2019-01-20 17:51:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:51:03 [DEBUG   ] Finished updating board flags in 0.973 seconds
2019-01-20 17:51:06 [DEBUG   ] Got command RPT from MCS: ref #1230354
2019-01-20 17:51:06 [DEBUG   ] summary = ERROR
2019-01-20 17:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230354  13 58503 64266709 A  ERRORERROR'
2019-01-20 17:51:06 [DEBUG   ] Got command RPT from MCS: ref #1230355
2019-01-20 17:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230355  77 58503 64266710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:51:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 17:51:27 [DEBUG   ] Got command BAM from MCS: ref #1230371
2019-01-20 17:51:27 [INFO    ] Finished processing BAM request
2019-01-20 17:51:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:51:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230371   8 58503 64287029 A  ERROR'
2019-01-20 17:51:27 [DEBUG   ] Got command BAM from MCS: ref #1230372
2019-01-20 17:51:27 [INFO    ] Finished processing BAM request
2019-01-20 17:51:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:51:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230372   8 58503 64287033 A  ERROR'
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:51:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:51:27 [DEBUG   ] spawn_process: at 2019-01-20 17:51:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:51:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 17:51:57 [DEBUG   ] Got command BAM from MCS: ref #1230373
2019-01-20 17:51:57 [INFO    ] Finished processing BAM request
2019-01-20 17:51:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:51:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230373   8 58503 64317033 A  ERROR'
2019-01-20 17:51:57 [DEBUG   ] Got command BAM from MCS: ref #1230374
2019-01-20 17:51:57 [INFO    ] Finished processing BAM request
2019-01-20 17:51:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:51:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230374   8 58503 64317037 A  ERROR'
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:51:57 [DEBUG   ] spawn_process: at 2019-01-20 17:51:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:51:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 17:52:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 17:52:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:52:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:52:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:52:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:52:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:52:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:52:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:52:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:52:04 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-01-20 17:52:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 17:52:27 [DEBUG   ] Got command BAM from MCS: ref #1230376
2019-01-20 17:52:27 [INFO    ] Finished processing BAM request
2019-01-20 17:52:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230376   8 58503 64347033 A  ERROR'
2019-01-20 17:52:27 [DEBUG   ] Got command BAM from MCS: ref #1230375
2019-01-20 17:52:27 [INFO    ] Finished processing BAM request
2019-01-20 17:52:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230375   8 58503 64347037 A  ERROR'
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:52:27 [DEBUG   ] spawn_process: at 2019-01-20 17:52:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:52:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 17:52:57 [DEBUG   ] Got command BAM from MCS: ref #1230382
2019-01-20 17:52:57 [INFO    ] Finished processing BAM request
2019-01-20 17:52:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:52:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230382   8 58503 64377025 A  ERROR'
2019-01-20 17:52:57 [DEBUG   ] Got command BAM from MCS: ref #1230381
2019-01-20 17:52:57 [INFO    ] Finished processing BAM request
2019-01-20 17:52:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:52:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230381   8 58503 64377029 A  ERROR'
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:52:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:52:57 [DEBUG   ] spawn_process: at 2019-01-20 17:52:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:52:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 17:53:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 17:53:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 17:53:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-20 17:53:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:53:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 17:53:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:53:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 17:53:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:53:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:53:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:53:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:53:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:53:04 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-01-20 17:53:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 17:53:25 [DEBUG   ] Got command RPT from MCS: ref #1230383
2019-01-20 17:53:25 [DEBUG   ] summary = ERROR
2019-01-20 17:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230383  13 58503 64405305 A  ERRORERROR'
2019-01-20 17:53:25 [DEBUG   ] Got command RPT from MCS: ref #1230384
2019-01-20 17:53:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230384  77 58503 64405509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:53:25 [DEBUG   ] Got command RPT from MCS: ref #1230385
2019-01-20 17:53:25 [DEBUG   ] summary = ERROR
2019-01-20 17:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230385  13 58503 64405713 A  ERRORERROR'
2019-01-20 17:53:25 [DEBUG   ] Got command RPT from MCS: ref #1230386
2019-01-20 17:53:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230386  77 58503 64405917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:53:26 [DEBUG   ] Got command RPT from MCS: ref #1230389
2019-01-20 17:53:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 17:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230389  12 58503 64406109 A  ERRORB£ff'
2019-01-20 17:53:27 [DEBUG   ] Got command BAM from MCS: ref #1230388
2019-01-20 17:53:27 [INFO    ] Finished processing BAM request
2019-01-20 17:53:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230388   8 58503 64407025 A  ERROR'
2019-01-20 17:53:27 [DEBUG   ] Got command BAM from MCS: ref #1230387
2019-01-20 17:53:27 [INFO    ] Finished processing BAM request
2019-01-20 17:53:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230387   8 58503 64407033 A  ERROR'
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:53:27 [DEBUG   ] spawn_process: at 2019-01-20 17:53:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:53:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 17:53:57 [DEBUG   ] Got command BAM from MCS: ref #1230391
2019-01-20 17:53:57 [INFO    ] Finished processing BAM request
2019-01-20 17:53:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:53:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230391   8 58503 64437033 A  ERROR'
2019-01-20 17:53:57 [DEBUG   ] Got command BAM from MCS: ref #1230390
2019-01-20 17:53:57 [INFO    ] Finished processing BAM request
2019-01-20 17:53:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:53:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230390   8 58503 64437037 A  ERROR'
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:53:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:53:57 [DEBUG   ] spawn_process: at 2019-01-20 17:53:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:53:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 17:54:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 17:54:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 17:54:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:54:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:54:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:54:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:54:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:54:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:54:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:54:04 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-01-20 17:54:18 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-20 17:54:27 [DEBUG   ] Got command BAM from MCS: ref #1230393
2019-01-20 17:54:27 [INFO    ] Finished processing BAM request
2019-01-20 17:54:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:54:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230393   8 58503 64467033 A  ERROR'
2019-01-20 17:54:27 [DEBUG   ] Got command BAM from MCS: ref #1230392
2019-01-20 17:54:27 [INFO    ] Finished processing BAM request
2019-01-20 17:54:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:54:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230392   8 58503 64467037 A  ERROR'
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:54:27 [DEBUG   ] spawn_process: at 2019-01-20 17:54:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:54:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:54:57 [DEBUG   ] Got command BAM from MCS: ref #1230395
2019-01-20 17:54:57 [INFO    ] Finished processing BAM request
2019-01-20 17:54:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230395   8 58503 64497037 A  ERROR'
2019-01-20 17:54:57 [DEBUG   ] Got command BAM from MCS: ref #1230394
2019-01-20 17:54:57 [INFO    ] Finished processing BAM request
2019-01-20 17:54:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230394   8 58503 64497045 A  ERROR'
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:54:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:54:57 [DEBUG   ] spawn_process: at 2019-01-20 17:54:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:54:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:55:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:55:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:55:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 17:55:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:55:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:55:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:55:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:55:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:55:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:55:04 [DEBUG   ] Finished updating board flags in 1.023 seconds
2019-01-20 17:55:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:55:27 [DEBUG   ] Got command BAM from MCS: ref #1230396
2019-01-20 17:55:27 [INFO    ] Finished processing BAM request
2019-01-20 17:55:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230396   8 58503 64527029 A  ERROR'
2019-01-20 17:55:27 [DEBUG   ] Got command BAM from MCS: ref #1230397
2019-01-20 17:55:27 [INFO    ] Finished processing BAM request
2019-01-20 17:55:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230397   8 58503 64527033 A  ERROR'
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:55:27 [DEBUG   ] spawn_process: at 2019-01-20 17:55:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:55:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:55:57 [DEBUG   ] Got command BAM from MCS: ref #1230402
2019-01-20 17:55:57 [INFO    ] Finished processing BAM request
2019-01-20 17:55:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:55:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230402   8 58503 64557029 A  ERROR'
2019-01-20 17:55:57 [DEBUG   ] Got command BAM from MCS: ref #1230403
2019-01-20 17:55:57 [INFO    ] Finished processing BAM request
2019-01-20 17:55:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:55:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230403   8 58503 64557033 A  ERROR'
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:55:57 [DEBUG   ] spawn_process: at 2019-01-20 17:55:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:55:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:56:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 17:56:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 17:56:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:56:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:56:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 17:56:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:56:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:56:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:56:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:56:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:56:04 [DEBUG   ] Finished updating board flags in 0.980 seconds
2019-01-20 17:56:06 [DEBUG   ] Got command RPT from MCS: ref #1230404
2019-01-20 17:56:06 [DEBUG   ] summary = ERROR
2019-01-20 17:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230404  13 58503 64566709 A  ERRORERROR'
2019-01-20 17:56:06 [DEBUG   ] Got command RPT from MCS: ref #1230405
2019-01-20 17:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230405  77 58503 64566710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:56:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:56:27 [DEBUG   ] Got command BAM from MCS: ref #1230422
2019-01-20 17:56:27 [INFO    ] Finished processing BAM request
2019-01-20 17:56:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:56:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230422   8 58503 64587029 A  ERROR'
2019-01-20 17:56:27 [DEBUG   ] Got command BAM from MCS: ref #1230421
2019-01-20 17:56:27 [INFO    ] Finished processing BAM request
2019-01-20 17:56:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:56:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230421   8 58503 64587033 A  ERROR'
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:56:27 [DEBUG   ] spawn_process: at 2019-01-20 17:56:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:56:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:56:57 [DEBUG   ] Got command BAM from MCS: ref #1230424
2019-01-20 17:56:57 [INFO    ] Finished processing BAM request
2019-01-20 17:56:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:56:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230424   8 58503 64617025 A  ERROR'
2019-01-20 17:56:57 [DEBUG   ] Got command BAM from MCS: ref #1230423
2019-01-20 17:56:57 [INFO    ] Finished processing BAM request
2019-01-20 17:56:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:56:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230423   8 58503 64617029 A  ERROR'
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:56:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:56:57 [DEBUG   ] spawn_process: at 2019-01-20 17:56:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:56:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:57:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:57:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:57:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 17:57:05 [WARNING ] (13, 1, 'bot')
2019-01-20 17:57:05 [WARNING ] (13, 1, 'bot')
2019-01-20 17:57:05 [WARNING ] (13, 1, 'bot')
2019-01-20 17:57:05 [WARNING ] (13, 1, 'bot')
2019-01-20 17:57:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:57:05 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-20 17:57:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:57:27 [DEBUG   ] Got command BAM from MCS: ref #1230425
2019-01-20 17:57:27 [INFO    ] Finished processing BAM request
2019-01-20 17:57:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230425   8 58503 64647029 A  ERROR'
2019-01-20 17:57:27 [DEBUG   ] Got command BAM from MCS: ref #1230426
2019-01-20 17:57:27 [INFO    ] Finished processing BAM request
2019-01-20 17:57:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230426   8 58503 64647033 A  ERROR'
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 17:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 17:57:27 [DEBUG   ] spawn_process: at 2019-01-20 17:57:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 17:57:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:57:58 [DEBUG   ] Got command BAM from MCS: ref #1230427
2019-01-20 17:57:58 [INFO    ] Finished processing BAM request
2019-01-20 17:57:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:57:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230427   8 58503 64678025 A  ERROR'
2019-01-20 17:57:58 [DEBUG   ] Got command BAM from MCS: ref #1230428
2019-01-20 17:57:58 [INFO    ] Finished processing BAM request
2019-01-20 17:57:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:57:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230428   8 58503 64678029 A  ERROR'
2019-01-20 17:57:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 17:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 17:57:58 [DEBUG   ] spawn_process: at 2019-01-20 17:57:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 17:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 17:58:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:58:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:58:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 17:58:05 [WARNING ] (13, 1, 'bot')
2019-01-20 17:58:05 [WARNING ] (13, 1, 'bot')
2019-01-20 17:58:05 [WARNING ] (13, 1, 'bot')
2019-01-20 17:58:05 [WARNING ] (13, 1, 'bot')
2019-01-20 17:58:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:58:05 [DEBUG   ] Finished updating board flags in 1.775 seconds
2019-01-20 17:58:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:58:25 [DEBUG   ] Got command RPT from MCS: ref #1230431
2019-01-20 17:58:25 [DEBUG   ] summary = ERROR
2019-01-20 17:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230431  13 58503 64705393 A  ERRORERROR'
2019-01-20 17:58:25 [DEBUG   ] Got command RPT from MCS: ref #1230432
2019-01-20 17:58:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230432  77 58503 64705597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:58:25 [DEBUG   ] Got command RPT from MCS: ref #1230433
2019-01-20 17:58:25 [DEBUG   ] summary = ERROR
2019-01-20 17:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230433  13 58503 64705801 A  ERRORERROR'
2019-01-20 17:58:25 [DEBUG   ] Got command RPT from MCS: ref #1230435
2019-01-20 17:58:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 17:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230435  77 58503 64705993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 17:58:26 [DEBUG   ] Got command RPT from MCS: ref #1230436
2019-01-20 17:58:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 17:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230436  12 58503 64706197 A  ERRORB£ff'
2019-01-20 17:58:29 [DEBUG   ] Got command BAM from MCS: ref #1230442
2019-01-20 17:58:29 [INFO    ] Finished processing BAM request
2019-01-20 17:58:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230442   8 58503 64709033 A  ERROR'
2019-01-20 17:58:29 [DEBUG   ] Got command BAM from MCS: ref #1230441
2019-01-20 17:58:29 [INFO    ] Finished processing BAM request
2019-01-20 17:58:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230441   8 58503 64709037 A  ERROR'
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 17:58:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 17:58:29 [DEBUG   ] spawn_process: at 2019-01-20 17:58:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 17:58:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 17:58:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 17:59:00 [DEBUG   ] Got command BAM from MCS: ref #1230447
2019-01-20 17:59:00 [INFO    ] Finished processing BAM request
2019-01-20 17:59:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230447   8 58503 64740025 A  ERROR'
2019-01-20 17:59:00 [DEBUG   ] Got command BAM from MCS: ref #1230448
2019-01-20 17:59:00 [INFO    ] Finished processing BAM request
2019-01-20 17:59:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230448   8 58503 64740029 A  ERROR'
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 17:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 17:59:00 [DEBUG   ] spawn_process: at 2019-01-20 17:59:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 17:59:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 17:59:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 17:59:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 17:59:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 17:59:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 17:59:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 17:59:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:59:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:59:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:59:04 [WARNING ] (13, 1, 'bot')
2019-01-20 17:59:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 17:59:04 [DEBUG   ] Finished updating board flags in 1.048 seconds
2019-01-20 17:59:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 17:59:31 [DEBUG   ] Got command BAM from MCS: ref #1230450
2019-01-20 17:59:31 [INFO    ] Finished processing BAM request
2019-01-20 17:59:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:59:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230450   8 58503 64771033 A  ERROR'
2019-01-20 17:59:31 [DEBUG   ] Got command BAM from MCS: ref #1230449
2019-01-20 17:59:31 [INFO    ] Finished processing BAM request
2019-01-20 17:59:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 17:59:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230449   8 58503 64771037 A  ERROR'
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 17:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 17:59:31 [DEBUG   ] spawn_process: at 2019-01-20 17:59:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 17:59:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 17:59:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:00:02 [DEBUG   ] Got command BAM from MCS: ref #1230451
2019-01-20 18:00:02 [INFO    ] Finished processing BAM request
2019-01-20 18:00:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:00:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230451   8 58503 64802025 A  ERROR'
2019-01-20 18:00:02 [DEBUG   ] Got command BAM from MCS: ref #1230452
2019-01-20 18:00:02 [INFO    ] Finished processing BAM request
2019-01-20 18:00:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:00:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230452   8 58503 64802029 A  ERROR'
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:00:02 [DEBUG   ] spawn_process: at 2019-01-20 18:00:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 18:00:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 18:00:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 18:00:04 [WARNING ] (13, 1, 'bot')
2019-01-20 18:00:04 [WARNING ] (13, 1, 'bot')
2019-01-20 18:00:04 [WARNING ] (13, 1, 'bot')
2019-01-20 18:00:04 [WARNING ] (13, 1, 'bot')
2019-01-20 18:00:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:00:04 [DEBUG   ] Finished updating board flags in 1.023 seconds
2019-01-20 18:00:18 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-20 18:00:33 [DEBUG   ] Got command BAM from MCS: ref #1230453
2019-01-20 18:00:33 [INFO    ] Finished processing BAM request
2019-01-20 18:00:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:00:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230453   8 58503 64833029 A  ERROR'
2019-01-20 18:00:33 [DEBUG   ] Got command BAM from MCS: ref #1230454
2019-01-20 18:00:33 [INFO    ] Finished processing BAM request
2019-01-20 18:00:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:00:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230454   8 58503 64833037 A  ERROR'
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:00:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:00:33 [DEBUG   ] spawn_process: at 2019-01-20 18:00:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:00:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 18:00:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 18:01:04 [DEBUG   ] Got command BAM from MCS: ref #1230456
2019-01-20 18:01:04 [INFO    ] Finished processing BAM request
2019-01-20 18:01:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230456   8 58503 64864033 A  ERROR'
2019-01-20 18:01:04 [DEBUG   ] Got command BAM from MCS: ref #1230455
2019-01-20 18:01:04 [INFO    ] Finished processing BAM request
2019-01-20 18:01:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230455   8 58503 64864037 A  ERROR'
2019-01-20 18:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 18:01:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 18:01:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:01:04 [DEBUG   ] spawn_process: at 2019-01-20 18:01:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:01:04 [WARNING ] (13, 1, 'bot')
2019-01-20 18:01:04 [WARNING ] (13, 1, 'bot')
2019-01-20 18:01:04 [WARNING ] (13, 1, 'bot')
2019-01-20 18:01:04 [WARNING ] (13, 1, 'bot')
2019-01-20 18:01:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:01:04 [DEBUG   ] Finished updating board flags in 1.092 seconds
2019-01-20 18:01:06 [DEBUG   ] Got command RPT from MCS: ref #1230457
2019-01-20 18:01:06 [DEBUG   ] summary = ERROR
2019-01-20 18:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230457  13 58503 64866717 A  ERRORERROR'
2019-01-20 18:01:06 [DEBUG   ] Got command RPT from MCS: ref #1230458
2019-01-20 18:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230458  77 58503 64866718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:01:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 18:01:35 [DEBUG   ] Got command BAM from MCS: ref #1230475
2019-01-20 18:01:35 [INFO    ] Finished processing BAM request
2019-01-20 18:01:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230475   8 58503 64895025 A  ERROR'
2019-01-20 18:01:35 [DEBUG   ] Got command BAM from MCS: ref #1230474
2019-01-20 18:01:35 [INFO    ] Finished processing BAM request
2019-01-20 18:01:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230474   8 58503 64895029 A  ERROR'
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 18:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 18:01:35 [DEBUG   ] spawn_process: at 2019-01-20 18:01:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 18:01:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 18:01:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 18:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 18:02:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 18:02:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:02:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 18:02:04 [WARNING ] (13, 1, 'bot')
2019-01-20 18:02:04 [WARNING ] (13, 1, 'bot')
2019-01-20 18:02:04 [WARNING ] (13, 1, 'bot')
2019-01-20 18:02:04 [WARNING ] (13, 1, 'bot')
2019-01-20 18:02:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:02:04 [DEBUG   ] Finished updating board flags in 0.901 seconds
2019-01-20 18:02:06 [DEBUG   ] Got command BAM from MCS: ref #1230480
2019-01-20 18:02:06 [INFO    ] Finished processing BAM request
2019-01-20 18:02:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:02:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230480   8 58503 64926025 A  ERROR'
2019-01-20 18:02:06 [DEBUG   ] Got command BAM from MCS: ref #1230481
2019-01-20 18:02:06 [INFO    ] Finished processing BAM request
2019-01-20 18:02:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:02:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230481   8 58503 64926029 A  ERROR'
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:02:06 [DEBUG   ] spawn_process: at 2019-01-20 18:02:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:02:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 18:02:37 [DEBUG   ] Got command BAM from MCS: ref #1230483
2019-01-20 18:02:37 [INFO    ] Finished processing BAM request
2019-01-20 18:02:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:02:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230483   8 58503 64957029 A  ERROR'
2019-01-20 18:02:37 [DEBUG   ] Got command BAM from MCS: ref #1230482
2019-01-20 18:02:37 [INFO    ] Finished processing BAM request
2019-01-20 18:02:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:02:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230482   8 58503 64957033 A  ERROR'
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:02:37 [DEBUG   ] spawn_process: at 2019-01-20 18:02:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:02:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 18:02:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 18:03:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 18:03:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 18:03:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-20 18:03:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 18:03:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:03:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:03:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:03:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:03:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:03:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:03:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:03:05 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-01-20 18:03:08 [DEBUG   ] Got command BAM from MCS: ref #1230485
2019-01-20 18:03:08 [INFO    ] Finished processing BAM request
2019-01-20 18:03:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230485   8 58503 64988033 A  ERROR'
2019-01-20 18:03:08 [DEBUG   ] Got command BAM from MCS: ref #1230484
2019-01-20 18:03:08 [INFO    ] Finished processing BAM request
2019-01-20 18:03:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230484   8 58503 64988037 A  ERROR'
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:03:08 [DEBUG   ] spawn_process: at 2019-01-20 18:03:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:03:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 18:03:25 [DEBUG   ] Got command RPT from MCS: ref #1230486
2019-01-20 18:03:25 [DEBUG   ] summary = ERROR
2019-01-20 18:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230486  13 58503 65005477 A  ERRORERROR'
2019-01-20 18:03:25 [DEBUG   ] Got command RPT from MCS: ref #1230487
2019-01-20 18:03:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230487  77 58503 65005681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:03:25 [DEBUG   ] Got command RPT from MCS: ref #1230488
2019-01-20 18:03:25 [DEBUG   ] summary = ERROR
2019-01-20 18:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230488  13 58503 65005885 A  ERRORERROR'
2019-01-20 18:03:26 [DEBUG   ] Got command RPT from MCS: ref #1230489
2019-01-20 18:03:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230489  77 58503 65006077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:03:26 [DEBUG   ] Got command RPT from MCS: ref #1230490
2019-01-20 18:03:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 18:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230490  12 58503 65006281 A  ERRORB¢ff'
2019-01-20 18:03:39 [DEBUG   ] Got command BAM from MCS: ref #1230491
2019-01-20 18:03:39 [INFO    ] Finished processing BAM request
2019-01-20 18:03:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230491   8 58503 65019025 A  ERROR'
2019-01-20 18:03:39 [DEBUG   ] Got command BAM from MCS: ref #1230492
2019-01-20 18:03:39 [INFO    ] Finished processing BAM request
2019-01-20 18:03:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230492   8 58503 65019029 A  ERROR'
2019-01-20 18:03:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 18:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 18:03:39 [DEBUG   ] spawn_process: at 2019-01-20 18:03:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 18:03:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 18:04:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 18:04:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:04:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:04:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:04:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:04:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:04:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:04:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:04:05 [DEBUG   ] Finished updating board flags in 1.194 seconds
2019-01-20 18:04:10 [DEBUG   ] Got command BAM from MCS: ref #1230494
2019-01-20 18:04:10 [INFO    ] Finished processing BAM request
2019-01-20 18:04:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:04:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230494   8 58503 65050033 A  ERROR'
2019-01-20 18:04:10 [DEBUG   ] Got command BAM from MCS: ref #1230493
2019-01-20 18:04:10 [INFO    ] Finished processing BAM request
2019-01-20 18:04:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:04:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230493   8 58503 65050037 A  ERROR'
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:04:10 [DEBUG   ] spawn_process: at 2019-01-20 18:04:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:04:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 18:04:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 18:04:41 [DEBUG   ] Got command BAM from MCS: ref #1230500
2019-01-20 18:04:41 [INFO    ] Finished processing BAM request
2019-01-20 18:04:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:04:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230500   8 58503 65081033 A  ERROR'
2019-01-20 18:04:41 [DEBUG   ] Got command BAM from MCS: ref #1230499
2019-01-20 18:04:41 [INFO    ] Finished processing BAM request
2019-01-20 18:04:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:04:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230499   8 58503 65081037 A  ERROR'
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:04:41 [DEBUG   ] spawn_process: at 2019-01-20 18:04:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:04:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 18:05:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:05:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 18:05:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:05:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:05:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:05:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:05:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:05:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:05:05 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-01-20 18:05:12 [DEBUG   ] Got command BAM from MCS: ref #1230502
2019-01-20 18:05:12 [INFO    ] Finished processing BAM request
2019-01-20 18:05:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:05:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230502   8 58503 65112029 A  ERROR'
2019-01-20 18:05:12 [DEBUG   ] Got command BAM from MCS: ref #1230501
2019-01-20 18:05:12 [INFO    ] Finished processing BAM request
2019-01-20 18:05:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:05:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230501   8 58503 65112033 A  ERROR'
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:05:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:05:12 [DEBUG   ] spawn_process: at 2019-01-20 18:05:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:05:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 18:05:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:05:43 [DEBUG   ] Got command BAM from MCS: ref #1230504
2019-01-20 18:05:43 [INFO    ] Finished processing BAM request
2019-01-20 18:05:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:05:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230504   8 58503 65143033 A  ERROR'
2019-01-20 18:05:43 [DEBUG   ] Got command BAM from MCS: ref #1230503
2019-01-20 18:05:43 [INFO    ] Finished processing BAM request
2019-01-20 18:05:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:05:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230503   8 58503 65143037 A  ERROR'
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:05:43 [DEBUG   ] spawn_process: at 2019-01-20 18:05:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:05:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:06:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 18:06:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 18:06:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-01-20 18:06:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 18:06:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:06:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:06:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:06:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:06:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:06:05 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-01-20 18:06:06 [DEBUG   ] Got command RPT from MCS: ref #1230505
2019-01-20 18:06:06 [DEBUG   ] summary = ERROR
2019-01-20 18:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230505  13 58503 65166717 A  ERRORERROR'
2019-01-20 18:06:06 [DEBUG   ] Got command RPT from MCS: ref #1230506
2019-01-20 18:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230506  77 58503 65166718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:06:14 [DEBUG   ] Got command BAM from MCS: ref #1230522
2019-01-20 18:06:14 [INFO    ] Finished processing BAM request
2019-01-20 18:06:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:06:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230522   8 58503 65174029 A  ERROR'
2019-01-20 18:06:14 [DEBUG   ] Got command BAM from MCS: ref #1230523
2019-01-20 18:06:14 [INFO    ] Finished processing BAM request
2019-01-20 18:06:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:06:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230523   8 58503 65174033 A  ERROR'
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:06:14 [DEBUG   ] spawn_process: at 2019-01-20 18:06:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:06:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:06:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:06:45 [DEBUG   ] Got command BAM from MCS: ref #1230525
2019-01-20 18:06:45 [INFO    ] Finished processing BAM request
2019-01-20 18:06:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230525   8 58503 65205025 A  ERROR'
2019-01-20 18:06:45 [DEBUG   ] Got command BAM from MCS: ref #1230524
2019-01-20 18:06:45 [INFO    ] Finished processing BAM request
2019-01-20 18:06:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230524   8 58503 65205029 A  ERROR'
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:06:45 [DEBUG   ] spawn_process: at 2019-01-20 18:06:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:06:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:07:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 18:07:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:07:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 18:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 18:07:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:07:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:07:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:07:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:07:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:07:05 [DEBUG   ] Finished updating board flags in 0.993 seconds
2019-01-20 18:07:16 [DEBUG   ] Got command BAM from MCS: ref #1230527
2019-01-20 18:07:16 [INFO    ] Finished processing BAM request
2019-01-20 18:07:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:07:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230527   8 58503 65236025 A  ERROR'
2019-01-20 18:07:16 [DEBUG   ] Got command BAM from MCS: ref #1230526
2019-01-20 18:07:16 [INFO    ] Finished processing BAM request
2019-01-20 18:07:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:07:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230526   8 58503 65236029 A  ERROR'
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:07:16 [DEBUG   ] spawn_process: at 2019-01-20 18:07:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:07:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:07:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:07:47 [DEBUG   ] Got command BAM from MCS: ref #1230532
2019-01-20 18:07:47 [INFO    ] Finished processing BAM request
2019-01-20 18:07:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:07:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230532   8 58503 65267029 A  ERROR'
2019-01-20 18:07:47 [DEBUG   ] Got command BAM from MCS: ref #1230533
2019-01-20 18:07:47 [INFO    ] Finished processing BAM request
2019-01-20 18:07:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:07:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230533   8 58503 65267033 A  ERROR'
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:07:47 [DEBUG   ] spawn_process: at 2019-01-20 18:07:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:07:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:08:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 18:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:08:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:08:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:08:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:08:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:08:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:08:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:08:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:08:05 [DEBUG   ] Finished updating board flags in 1.273 seconds
2019-01-20 18:08:18 [DEBUG   ] Got command BAM from MCS: ref #1230537
2019-01-20 18:08:18 [INFO    ] Finished processing BAM request
2019-01-20 18:08:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230537   8 58503 65298025 A  ERROR'
2019-01-20 18:08:18 [DEBUG   ] Got command BAM from MCS: ref #1230536
2019-01-20 18:08:18 [INFO    ] Finished processing BAM request
2019-01-20 18:08:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230536   8 58503 65298029 A  ERROR'
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:08:18 [DEBUG   ] spawn_process: at 2019-01-20 18:08:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:08:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:08:25 [DEBUG   ] Got command RPT from MCS: ref #1230538
2019-01-20 18:08:25 [DEBUG   ] summary = ERROR
2019-01-20 18:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230538  13 58503 65305565 A  ERRORERROR'
2019-01-20 18:08:25 [DEBUG   ] Got command RPT from MCS: ref #1230539
2019-01-20 18:08:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230539  77 58503 65305769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:08:25 [DEBUG   ] Got command RPT from MCS: ref #1230540
2019-01-20 18:08:25 [DEBUG   ] summary = ERROR
2019-01-20 18:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230540  13 58503 65305961 A  ERRORERROR'
2019-01-20 18:08:26 [DEBUG   ] Got command RPT from MCS: ref #1230541
2019-01-20 18:08:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230541  77 58503 65306165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:08:26 [DEBUG   ] Got command RPT from MCS: ref #1230543
2019-01-20 18:08:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 18:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230543  12 58503 65306369 A  ERRORB£ff'
2019-01-20 18:08:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:08:49 [DEBUG   ] Got command BAM from MCS: ref #1230548
2019-01-20 18:08:49 [INFO    ] Finished processing BAM request
2019-01-20 18:08:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:08:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230548   8 58503 65329145 A  ERROR'
2019-01-20 18:08:49 [DEBUG   ] Got command BAM from MCS: ref #1230549
2019-01-20 18:08:49 [INFO    ] Finished processing BAM request
2019-01-20 18:08:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:08:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230549   8 58503 65329149 A  ERROR'
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:08:49 [DEBUG   ] spawn_process: at 2019-01-20 18:08:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:08:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:09:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:09:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:09:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:09:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:09:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:09:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:09:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:09:05 [DEBUG   ] Finished updating board flags in 1.184 seconds
2019-01-20 18:09:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:09:20 [DEBUG   ] Got command BAM from MCS: ref #1230550
2019-01-20 18:09:20 [INFO    ] Finished processing BAM request
2019-01-20 18:09:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230550   8 58503 65360025 A  ERROR'
2019-01-20 18:09:20 [DEBUG   ] Got command BAM from MCS: ref #1230551
2019-01-20 18:09:20 [INFO    ] Finished processing BAM request
2019-01-20 18:09:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230551   8 58503 65360029 A  ERROR'
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:09:20 [DEBUG   ] spawn_process: at 2019-01-20 18:09:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:09:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:09:51 [DEBUG   ] Got command BAM from MCS: ref #1230552
2019-01-20 18:09:51 [INFO    ] Finished processing BAM request
2019-01-20 18:09:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230552   8 58503 65391029 A  ERROR'
2019-01-20 18:09:51 [DEBUG   ] Got command BAM from MCS: ref #1230553
2019-01-20 18:09:51 [INFO    ] Finished processing BAM request
2019-01-20 18:09:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230553   8 58503 65391033 A  ERROR'
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 18:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 18:09:51 [DEBUG   ] spawn_process: at 2019-01-20 18:09:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 18:09:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:10:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:10:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 18:10:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:10:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:10:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 18:10:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:10:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:10:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:10:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:10:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:10:05 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-01-20 18:10:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:10:22 [DEBUG   ] Got command BAM from MCS: ref #1230554
2019-01-20 18:10:22 [INFO    ] Finished processing BAM request
2019-01-20 18:10:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:10:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230554   8 58503 65422025 A  ERROR'
2019-01-20 18:10:22 [DEBUG   ] Got command BAM from MCS: ref #1230555
2019-01-20 18:10:22 [INFO    ] Finished processing BAM request
2019-01-20 18:10:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:10:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230555   8 58503 65422029 A  ERROR'
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:10:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:10:22 [DEBUG   ] spawn_process: at 2019-01-20 18:10:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:10:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:10:53 [DEBUG   ] Got command BAM from MCS: ref #1230561
2019-01-20 18:10:53 [INFO    ] Finished processing BAM request
2019-01-20 18:10:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:10:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230561   8 58503 65453029 A  ERROR'
2019-01-20 18:10:53 [DEBUG   ] Got command BAM from MCS: ref #1230560
2019-01-20 18:10:53 [INFO    ] Finished processing BAM request
2019-01-20 18:10:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:10:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230560   8 58503 65453033 A  ERROR'
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:10:53 [DEBUG   ] spawn_process: at 2019-01-20 18:10:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:10:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 18:11:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 18:11:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:11:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:11:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:11:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:11:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:11:05 [WARNING ] (13, 1, 'bot')
2019-01-20 18:11:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:11:05 [DEBUG   ] Finished updating board flags in 0.973 seconds
2019-01-20 18:11:06 [DEBUG   ] Got command RPT from MCS: ref #1230562
2019-01-20 18:11:06 [DEBUG   ] summary = ERROR
2019-01-20 18:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230562  13 58503 65466713 A  ERRORERROR'
2019-01-20 18:11:06 [DEBUG   ] Got command RPT from MCS: ref #1230563
2019-01-20 18:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230563  77 58503 65466714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:11:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:11:24 [DEBUG   ] Got command BAM from MCS: ref #1230580
2019-01-20 18:11:24 [INFO    ] Finished processing BAM request
2019-01-20 18:11:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:11:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230580   8 58503 65484025 A  ERROR'
2019-01-20 18:11:24 [DEBUG   ] Got command BAM from MCS: ref #1230579
2019-01-20 18:11:24 [INFO    ] Finished processing BAM request
2019-01-20 18:11:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:11:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230579   8 58503 65484029 A  ERROR'
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:11:24 [DEBUG   ] spawn_process: at 2019-01-20 18:11:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:11:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:11:55 [DEBUG   ] Got command BAM from MCS: ref #1230582
2019-01-20 18:11:55 [INFO    ] Finished processing BAM request
2019-01-20 18:11:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230582   8 58503 65515029 A  ERROR'
2019-01-20 18:11:55 [DEBUG   ] Got command BAM from MCS: ref #1230581
2019-01-20 18:11:55 [INFO    ] Finished processing BAM request
2019-01-20 18:11:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230581   8 58503 65515033 A  ERROR'
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 18:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 18:11:55 [DEBUG   ] spawn_process: at 2019-01-20 18:11:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 18:11:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:12:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 18:12:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 18:12:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:12:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:12:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:12:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:12:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:12:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:12:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:12:06 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-01-20 18:12:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:12:26 [DEBUG   ] Got command BAM from MCS: ref #1230583
2019-01-20 18:12:26 [INFO    ] Finished processing BAM request
2019-01-20 18:12:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230583   8 58503 65546029 A  ERROR'
2019-01-20 18:12:26 [DEBUG   ] Got command BAM from MCS: ref #1230584
2019-01-20 18:12:26 [INFO    ] Finished processing BAM request
2019-01-20 18:12:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230584   8 58503 65546033 A  ERROR'
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:12:26 [DEBUG   ] spawn_process: at 2019-01-20 18:12:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:12:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:12:57 [DEBUG   ] Got command BAM from MCS: ref #1230585
2019-01-20 18:12:57 [INFO    ] Finished processing BAM request
2019-01-20 18:12:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:12:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230585   8 58503 65577025 A  ERROR'
2019-01-20 18:12:57 [DEBUG   ] Got command BAM from MCS: ref #1230586
2019-01-20 18:12:57 [INFO    ] Finished processing BAM request
2019-01-20 18:12:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:12:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230586   8 58503 65577029 A  ERROR'
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:12:57 [DEBUG   ] spawn_process: at 2019-01-20 18:12:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:12:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:13:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 18:13:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:13:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:13:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:13:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:13:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:13:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:13:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:13:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:13:06 [DEBUG   ] Finished updating board flags in 1.191 seconds
2019-01-20 18:13:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:13:25 [DEBUG   ] Got command RPT from MCS: ref #1230587
2019-01-20 18:13:25 [DEBUG   ] summary = ERROR
2019-01-20 18:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230587  13 58503 65605653 A  ERRORERROR'
2019-01-20 18:13:25 [DEBUG   ] Got command RPT from MCS: ref #1230588
2019-01-20 18:13:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230588  77 58503 65605857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:13:26 [DEBUG   ] Got command RPT from MCS: ref #1230589
2019-01-20 18:13:26 [DEBUG   ] summary = ERROR
2019-01-20 18:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230589  13 58503 65606049 A  ERRORERROR'
2019-01-20 18:13:26 [DEBUG   ] Got command RPT from MCS: ref #1230590
2019-01-20 18:13:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230590  77 58503 65606253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:13:26 [DEBUG   ] Got command RPT from MCS: ref #1230591
2019-01-20 18:13:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 18:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230591  12 58503 65606457 A  ERRORB£ff'
2019-01-20 18:13:28 [DEBUG   ] Got command BAM from MCS: ref #1230592
2019-01-20 18:13:28 [INFO    ] Finished processing BAM request
2019-01-20 18:13:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230592   8 58503 65608033 A  ERROR'
2019-01-20 18:13:28 [DEBUG   ] Got command BAM from MCS: ref #1230593
2019-01-20 18:13:28 [INFO    ] Finished processing BAM request
2019-01-20 18:13:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230593   8 58503 65608037 A  ERROR'
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:13:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:13:28 [DEBUG   ] spawn_process: at 2019-01-20 18:13:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:13:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:13:59 [DEBUG   ] Got command BAM from MCS: ref #1230598
2019-01-20 18:13:59 [INFO    ] Finished processing BAM request
2019-01-20 18:13:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230598   8 58503 65639029 A  ERROR'
2019-01-20 18:13:59 [DEBUG   ] Got command BAM from MCS: ref #1230599
2019-01-20 18:13:59 [INFO    ] Finished processing BAM request
2019-01-20 18:13:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230599   8 58503 65639033 A  ERROR'
2019-01-20 18:13:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:13:59 [DEBUG   ] spawn_process: at 2019-01-20 18:13:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:14:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 18:14:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:14:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 18:14:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:14:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:14:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:14:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:14:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:14:06 [DEBUG   ] Finished updating board flags in 1.137 seconds
2019-01-20 18:14:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:14:30 [DEBUG   ] Got command BAM from MCS: ref #1230600
2019-01-20 18:14:30 [INFO    ] Finished processing BAM request
2019-01-20 18:14:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230600   8 58503 65670033 A  ERROR'
2019-01-20 18:14:30 [DEBUG   ] Got command BAM from MCS: ref #1230601
2019-01-20 18:14:30 [INFO    ] Finished processing BAM request
2019-01-20 18:14:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230601   8 58503 65670037 A  ERROR'
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:14:30 [DEBUG   ] spawn_process: at 2019-01-20 18:14:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:14:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:14:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:15:01 [DEBUG   ] Got command BAM from MCS: ref #1230602
2019-01-20 18:15:01 [INFO    ] Finished processing BAM request
2019-01-20 18:15:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230602   8 58503 65701033 A  ERROR'
2019-01-20 18:15:01 [DEBUG   ] Got command BAM from MCS: ref #1230603
2019-01-20 18:15:01 [INFO    ] Finished processing BAM request
2019-01-20 18:15:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230603   8 58503 65701037 A  ERROR'
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:15:01 [DEBUG   ] spawn_process: at 2019-01-20 18:15:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 18:15:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 18:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 18:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-20 18:15:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:15:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:15:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:15:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:15:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:15:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:15:06 [DEBUG   ] Finished updating board flags in 1.325 seconds
2019-01-20 18:15:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:15:32 [DEBUG   ] Got command BAM from MCS: ref #1230604
2019-01-20 18:15:32 [INFO    ] Finished processing BAM request
2019-01-20 18:15:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:15:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230604   8 58503 65732025 A  ERROR'
2019-01-20 18:15:32 [DEBUG   ] Got command BAM from MCS: ref #1230605
2019-01-20 18:15:32 [INFO    ] Finished processing BAM request
2019-01-20 18:15:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:15:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230605   8 58503 65732029 A  ERROR'
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:15:32 [DEBUG   ] spawn_process: at 2019-01-20 18:15:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:15:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:15:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:16:03 [DEBUG   ] Got command BAM from MCS: ref #1230606
2019-01-20 18:16:03 [INFO    ] Finished processing BAM request
2019-01-20 18:16:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:16:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230606   8 58503 65763033 A  ERROR'
2019-01-20 18:16:03 [DEBUG   ] Got command BAM from MCS: ref #1230607
2019-01-20 18:16:03 [INFO    ] Finished processing BAM request
2019-01-20 18:16:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:16:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230607   8 58503 65763037 A  ERROR'
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:16:03 [DEBUG   ] spawn_process: at 2019-01-20 18:16:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:16:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 18:16:06 [DEBUG   ] Got command RPT from MCS: ref #1230608
2019-01-20 18:16:06 [DEBUG   ] summary = ERROR
2019-01-20 18:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230608  13 58503 65766713 A  ERRORERROR'
2019-01-20 18:16:06 [DEBUG   ] Got command RPT from MCS: ref #1230609
2019-01-20 18:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230609  77 58503 65766714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:16:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:16:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:16:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:16:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:16:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:16:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:16:06 [DEBUG   ] Finished updating board flags in 1.202 seconds
2019-01-20 18:16:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:16:34 [DEBUG   ] Got command BAM from MCS: ref #1230626
2019-01-20 18:16:34 [INFO    ] Finished processing BAM request
2019-01-20 18:16:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230626   8 58503 65794025 A  ERROR'
2019-01-20 18:16:34 [DEBUG   ] Got command BAM from MCS: ref #1230625
2019-01-20 18:16:34 [INFO    ] Finished processing BAM request
2019-01-20 18:16:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230625   8 58503 65794029 A  ERROR'
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:16:34 [DEBUG   ] spawn_process: at 2019-01-20 18:16:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:16:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:16:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:17:05 [DEBUG   ] Got command BAM from MCS: ref #1230632
2019-01-20 18:17:05 [INFO    ] Finished processing BAM request
2019-01-20 18:17:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:17:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230632   8 58503 65825025 A  ERROR'
2019-01-20 18:17:05 [DEBUG   ] Got command BAM from MCS: ref #1230631
2019-01-20 18:17:05 [INFO    ] Finished processing BAM request
2019-01-20 18:17:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:17:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230631   8 58503 65825029 A  ERROR'
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:17:05 [DEBUG   ] spawn_process: at 2019-01-20 18:17:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 18:17:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 18:17:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:17:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 18:17:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:17:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:17:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:17:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:17:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:17:06 [DEBUG   ] Finished updating board flags in 1.188 seconds
2019-01-20 18:17:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:17:36 [DEBUG   ] Got command BAM from MCS: ref #1230633
2019-01-20 18:17:36 [INFO    ] Finished processing BAM request
2019-01-20 18:17:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:17:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230633   8 58503 65856025 A  ERROR'
2019-01-20 18:17:36 [DEBUG   ] Got command BAM from MCS: ref #1230634
2019-01-20 18:17:36 [INFO    ] Finished processing BAM request
2019-01-20 18:17:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:17:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230634   8 58503 65856029 A  ERROR'
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:17:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:17:36 [DEBUG   ] spawn_process: at 2019-01-20 18:17:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:17:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:17:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 18:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2019-01-20 18:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 18:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-20 18:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:18:07 [DEBUG   ] Got command BAM from MCS: ref #1230636
2019-01-20 18:18:07 [INFO    ] Finished processing BAM request
2019-01-20 18:18:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230636   8 58503 65887027 A  ERROR'
2019-01-20 18:18:07 [DEBUG   ] Got command BAM from MCS: ref #1230635
2019-01-20 18:18:07 [INFO    ] Finished processing BAM request
2019-01-20 18:18:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230635   8 58503 65887033 A  ERROR'
2019-01-20 18:18:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:18:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:18:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:18:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:18:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:18:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:18:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:18:07 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:18:07 [DEBUG   ] spawn_process: at 2019-01-20 18:18:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:18:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:18:25 [DEBUG   ] Got command RPT from MCS: ref #1230639
2019-01-20 18:18:25 [DEBUG   ] summary = ERROR
2019-01-20 18:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230639  13 58503 65905737 A  ERRORERROR'
2019-01-20 18:18:25 [DEBUG   ] Got command RPT from MCS: ref #1230640
2019-01-20 18:18:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230640  77 58503 65905941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:18:26 [DEBUG   ] Got command RPT from MCS: ref #1230641
2019-01-20 18:18:26 [DEBUG   ] summary = ERROR
2019-01-20 18:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230641  13 58503 65906133 A  ERRORERROR'
2019-01-20 18:18:26 [DEBUG   ] Got command RPT from MCS: ref #1230643
2019-01-20 18:18:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230643  77 58503 65906337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:18:26 [DEBUG   ] Got command RPT from MCS: ref #1230645
2019-01-20 18:18:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 18:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230645  12 58503 65906541 A  ERRORB¤ff'
2019-01-20 18:18:38 [DEBUG   ] Got command BAM from MCS: ref #1230649
2019-01-20 18:18:38 [INFO    ] Finished processing BAM request
2019-01-20 18:18:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230649   8 58503 65918033 A  ERROR'
2019-01-20 18:18:38 [DEBUG   ] Got command BAM from MCS: ref #1230650
2019-01-20 18:18:38 [INFO    ] Finished processing BAM request
2019-01-20 18:18:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230650   8 58503 65918041 A  ERROR'
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:18:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:18:38 [DEBUG   ] spawn_process: at 2019-01-20 18:18:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:18:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:18:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 18:19:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 18:19:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-01-20 18:19:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:19:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 18:19:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:19:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:19:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:19:06 [WARNING ] (13, 1, 'bot')
2019-01-20 18:19:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:19:06 [DEBUG   ] Finished updating board flags in 0.995 seconds
2019-01-20 18:19:09 [DEBUG   ] Got command BAM from MCS: ref #1230652
2019-01-20 18:19:09 [INFO    ] Finished processing BAM request
2019-01-20 18:19:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:19:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230652   8 58503 65949029 A  ERROR'
2019-01-20 18:19:09 [DEBUG   ] Got command BAM from MCS: ref #1230651
2019-01-20 18:19:09 [INFO    ] Finished processing BAM request
2019-01-20 18:19:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:19:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230651   8 58503 65949033 A  ERROR'
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:19:09 [DEBUG   ] spawn_process: at 2019-01-20 18:19:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:19:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:19:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:19:40 [DEBUG   ] Got command BAM from MCS: ref #1230658
2019-01-20 18:19:40 [INFO    ] Finished processing BAM request
2019-01-20 18:19:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230658   8 58503 65980033 A  ERROR'
2019-01-20 18:19:40 [DEBUG   ] Got command BAM from MCS: ref #1230657
2019-01-20 18:19:40 [INFO    ] Finished processing BAM request
2019-01-20 18:19:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230657   8 58503 65980037 A  ERROR'
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:19:40 [DEBUG   ] spawn_process: at 2019-01-20 18:19:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:19:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:20:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 18:20:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:20:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:20:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:20:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:20:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:20:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:20:07 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-01-20 18:20:11 [DEBUG   ] Got command BAM from MCS: ref #1230660
2019-01-20 18:20:11 [INFO    ] Finished processing BAM request
2019-01-20 18:20:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230660   8 58503 66011033 A  ERROR'
2019-01-20 18:20:11 [DEBUG   ] Got command BAM from MCS: ref #1230659
2019-01-20 18:20:11 [INFO    ] Finished processing BAM request
2019-01-20 18:20:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230659   8 58503 66011037 A  ERROR'
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:20:11 [DEBUG   ] spawn_process: at 2019-01-20 18:20:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:20:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:20:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:20:43 [DEBUG   ] Got command BAM from MCS: ref #1230662
2019-01-20 18:20:43 [INFO    ] Finished processing BAM request
2019-01-20 18:20:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:20:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230662   8 58503 66043025 A  ERROR'
2019-01-20 18:20:43 [DEBUG   ] Got command BAM from MCS: ref #1230661
2019-01-20 18:20:43 [INFO    ] Finished processing BAM request
2019-01-20 18:20:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:20:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230661   8 58503 66043029 A  ERROR'
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 18:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 18:20:43 [DEBUG   ] spawn_process: at 2019-01-20 18:20:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 18:20:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 18:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 18:21:06 [DEBUG   ] Got command RPT from MCS: ref #1230663
2019-01-20 18:21:06 [DEBUG   ] summary = ERROR
2019-01-20 18:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230663  13 58503 66066713 A  ERRORERROR'
2019-01-20 18:21:06 [DEBUG   ] Got command RPT from MCS: ref #1230664
2019-01-20 18:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230664  77 58503 66066714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:21:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:21:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:21:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:21:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:21:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:21:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:21:07 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-01-20 18:21:15 [DEBUG   ] Got command BAM from MCS: ref #1230681
2019-01-20 18:21:15 [INFO    ] Finished processing BAM request
2019-01-20 18:21:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:21:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230681   8 58503 66075033 A  ERROR'
2019-01-20 18:21:15 [DEBUG   ] Got command BAM from MCS: ref #1230680
2019-01-20 18:21:15 [INFO    ] Finished processing BAM request
2019-01-20 18:21:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:21:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230680   8 58503 66075037 A  ERROR'
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:21:15 [DEBUG   ] spawn_process: at 2019-01-20 18:21:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:21:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:21:16 [DEBUG   ] spawn_process: at 2019-01-20 18:21:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:21:19 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-20 18:21:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:21:47 [DEBUG   ] Got command BAM from MCS: ref #1230682
2019-01-20 18:21:47 [INFO    ] Finished processing BAM request
2019-01-20 18:21:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:21:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230682   8 58503 66107025 A  ERROR'
2019-01-20 18:21:47 [DEBUG   ] Got command BAM from MCS: ref #1230683
2019-01-20 18:21:47 [INFO    ] Finished processing BAM request
2019-01-20 18:21:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:21:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230683   8 58503 66107029 A  ERROR'
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:21:47 [DEBUG   ] spawn_process: at 2019-01-20 18:21:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:21:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:22:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 18:22:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:22:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:22:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 18:22:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:22:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:22:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:22:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:22:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:22:07 [DEBUG   ] Finished updating board flags in 1.192 seconds
2019-01-20 18:22:19 [DEBUG   ] Got command BAM from MCS: ref #1230685
2019-01-20 18:22:19 [INFO    ] Finished processing BAM request
2019-01-20 18:22:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230685   8 58503 66139029 A  ERROR'
2019-01-20 18:22:19 [DEBUG   ] Got command BAM from MCS: ref #1230684
2019-01-20 18:22:19 [INFO    ] Finished processing BAM request
2019-01-20 18:22:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230684   8 58503 66139033 A  ERROR'
2019-01-20 18:22:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:22:19 [DEBUG   ] spawn_process: at 2019-01-20 18:22:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:22:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:22:51 [DEBUG   ] Got command BAM from MCS: ref #1230691
2019-01-20 18:22:51 [INFO    ] Finished processing BAM request
2019-01-20 18:22:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:22:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230691   8 58503 66171025 A  ERROR'
2019-01-20 18:22:51 [DEBUG   ] Got command BAM from MCS: ref #1230690
2019-01-20 18:22:51 [INFO    ] Finished processing BAM request
2019-01-20 18:22:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:22:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230690   8 58503 66171029 A  ERROR'
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:22:51 [DEBUG   ] spawn_process: at 2019-01-20 18:22:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:22:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:23:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:23:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:23:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:23:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:23:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:23:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:23:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:23:07 [DEBUG   ] Finished updating board flags in 0.997 seconds
2019-01-20 18:23:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:23:23 [DEBUG   ] Got command BAM from MCS: ref #1230692
2019-01-20 18:23:23 [INFO    ] Finished processing BAM request
2019-01-20 18:23:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230692   8 58503 66203029 A  ERROR'
2019-01-20 18:23:23 [DEBUG   ] Got command BAM from MCS: ref #1230693
2019-01-20 18:23:23 [INFO    ] Finished processing BAM request
2019-01-20 18:23:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230693   8 58503 66203033 A  ERROR'
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:23:23 [DEBUG   ] spawn_process: at 2019-01-20 18:23:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:23:25 [DEBUG   ] Got command RPT from MCS: ref #1230694
2019-01-20 18:23:25 [DEBUG   ] summary = ERROR
2019-01-20 18:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230694  13 58503 66205829 A  ERRORERROR'
2019-01-20 18:23:26 [DEBUG   ] Got command RPT from MCS: ref #1230695
2019-01-20 18:23:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230695  77 58503 66206021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:23:26 [DEBUG   ] Got command RPT from MCS: ref #1230696
2019-01-20 18:23:26 [DEBUG   ] summary = ERROR
2019-01-20 18:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230696  13 58503 66206225 A  ERRORERROR'
2019-01-20 18:23:26 [DEBUG   ] Got command RPT from MCS: ref #1230697
2019-01-20 18:23:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230697  77 58503 66206429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:23:26 [DEBUG   ] Got command RPT from MCS: ref #1230698
2019-01-20 18:23:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 18:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230698  12 58503 66206633 A  ERRORB¢ff'
2019-01-20 18:23:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:23:55 [DEBUG   ] Got command BAM from MCS: ref #1230699
2019-01-20 18:23:55 [INFO    ] Finished processing BAM request
2019-01-20 18:23:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:23:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230699   8 58503 66235033 A  ERROR'
2019-01-20 18:23:55 [DEBUG   ] Got command BAM from MCS: ref #1230700
2019-01-20 18:23:55 [INFO    ] Finished processing BAM request
2019-01-20 18:23:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:23:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230700   8 58503 66235037 A  ERROR'
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 18:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 18:23:55 [DEBUG   ] spawn_process: at 2019-01-20 18:23:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 18:23:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 18:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 18:24:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:24:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:24:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:24:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:24:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:24:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:24:07 [DEBUG   ] Finished updating board flags in 1.265 seconds
2019-01-20 18:24:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:24:27 [DEBUG   ] Got command BAM from MCS: ref #1230701
2019-01-20 18:24:27 [INFO    ] Finished processing BAM request
2019-01-20 18:24:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:24:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230701   8 58503 66267029 A  ERROR'
2019-01-20 18:24:27 [DEBUG   ] Got command BAM from MCS: ref #1230702
2019-01-20 18:24:27 [INFO    ] Finished processing BAM request
2019-01-20 18:24:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:24:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230702   8 58503 66267033 A  ERROR'
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:24:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:24:27 [DEBUG   ] spawn_process: at 2019-01-20 18:24:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:24:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:24:59 [DEBUG   ] Got command BAM from MCS: ref #1230704
2019-01-20 18:24:59 [INFO    ] Finished processing BAM request
2019-01-20 18:24:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230704   8 58503 66299025 A  ERROR'
2019-01-20 18:24:59 [DEBUG   ] Got command BAM from MCS: ref #1230703
2019-01-20 18:24:59 [INFO    ] Finished processing BAM request
2019-01-20 18:24:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230703   8 58503 66299029 A  ERROR'
2019-01-20 18:24:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:24:59 [DEBUG   ] spawn_process: at 2019-01-20 18:24:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 18:25:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:25:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 18:25:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:25:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:25:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:25:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:25:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:25:07 [DEBUG   ] Finished updating board flags in 1.187 seconds
2019-01-20 18:25:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:25:31 [DEBUG   ] Got command BAM from MCS: ref #1230705
2019-01-20 18:25:31 [INFO    ] Finished processing BAM request
2019-01-20 18:25:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230705   8 58503 66331025 A  ERROR'
2019-01-20 18:25:31 [DEBUG   ] Got command BAM from MCS: ref #1230706
2019-01-20 18:25:31 [INFO    ] Finished processing BAM request
2019-01-20 18:25:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230706   8 58503 66331029 A  ERROR'
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:25:31 [DEBUG   ] spawn_process: at 2019-01-20 18:25:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:25:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:25:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:26:03 [DEBUG   ] Got command BAM from MCS: ref #1230712
2019-01-20 18:26:03 [INFO    ] Finished processing BAM request
2019-01-20 18:26:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:26:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230712   8 58503 66363029 A  ERROR'
2019-01-20 18:26:03 [DEBUG   ] Got command BAM from MCS: ref #1230711
2019-01-20 18:26:03 [INFO    ] Finished processing BAM request
2019-01-20 18:26:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:26:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230711   8 58503 66363033 A  ERROR'
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 18:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 18:26:03 [DEBUG   ] spawn_process: at 2019-01-20 18:26:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 18:26:06 [DEBUG   ] Got command RPT from MCS: ref #1230713
2019-01-20 18:26:06 [DEBUG   ] summary = ERROR
2019-01-20 18:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230713  13 58503 66366717 A  ERRORERROR'
2019-01-20 18:26:06 [DEBUG   ] Got command RPT from MCS: ref #1230714
2019-01-20 18:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230714  77 58503 66366718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:26:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:26:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:26:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:26:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:26:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:26:07 [WARNING ] (13, 1, 'bot')
2019-01-20 18:26:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:26:07 [DEBUG   ] Finished updating board flags in 1.009 seconds
2019-01-20 18:26:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:26:35 [DEBUG   ] Got command BAM from MCS: ref #1230731
2019-01-20 18:26:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:26:35 [INFO    ] Finished processing BAM request
2019-01-20 18:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230731   8 58503 66395061 A  ERROR'
2019-01-20 18:26:35 [DEBUG   ] Got command BAM from MCS: ref #1230730
2019-01-20 18:26:35 [INFO    ] Finished processing BAM request
2019-01-20 18:26:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230730   8 58503 66395065 A  ERROR'
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:26:35 [DEBUG   ] spawn_process: at 2019-01-20 18:26:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:26:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:26:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:27:07 [DEBUG   ] Got command BAM from MCS: ref #1230733
2019-01-20 18:27:07 [INFO    ] Finished processing BAM request
2019-01-20 18:27:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:27:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230733   8 58503 66427025 A  ERROR'
2019-01-20 18:27:07 [DEBUG   ] Got command BAM from MCS: ref #1230732
2019-01-20 18:27:07 [INFO    ] Finished processing BAM request
2019-01-20 18:27:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:27:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230732   8 58503 66427029 A  ERROR'
2019-01-20 18:27:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 18:27:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 18:27:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:27:07 [DEBUG   ] spawn_process: at 2019-01-20 18:27:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:27:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:27:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:27:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:27:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:27:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:27:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:27:08 [DEBUG   ] Finished updating board flags in 1.547 seconds
2019-01-20 18:27:19 [DEBUG   ] Finished updating ant stats in 0.587 seconds
2019-01-20 18:27:39 [DEBUG   ] Got command BAM from MCS: ref #1230734
2019-01-20 18:27:39 [INFO    ] Finished processing BAM request
2019-01-20 18:27:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230734   8 58503 66459029 A  ERROR'
2019-01-20 18:27:39 [DEBUG   ] Got command BAM from MCS: ref #1230735
2019-01-20 18:27:39 [INFO    ] Finished processing BAM request
2019-01-20 18:27:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230735   8 58503 66459033 A  ERROR'
2019-01-20 18:27:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:27:39 [DEBUG   ] spawn_process: at 2019-01-20 18:27:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:27:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 18:28:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:28:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:28:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:28:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:28:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:28:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:28:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:28:08 [DEBUG   ] Finished updating board flags in 1.453 seconds
2019-01-20 18:28:11 [DEBUG   ] Got command BAM from MCS: ref #1230738
2019-01-20 18:28:11 [INFO    ] Finished processing BAM request
2019-01-20 18:28:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230738   8 58503 66491029 A  ERROR'
2019-01-20 18:28:11 [DEBUG   ] Got command BAM from MCS: ref #1230739
2019-01-20 18:28:11 [INFO    ] Finished processing BAM request
2019-01-20 18:28:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230739   8 58503 66491033 A  ERROR'
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:28:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:28:11 [DEBUG   ] spawn_process: at 2019-01-20 18:28:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:28:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 18:28:25 [DEBUG   ] Got command RPT from MCS: ref #1230740
2019-01-20 18:28:25 [DEBUG   ] summary = ERROR
2019-01-20 18:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230740  13 58503 66505916 A  ERRORERROR'
2019-01-20 18:28:26 [DEBUG   ] Got command RPT from MCS: ref #1230741
2019-01-20 18:28:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230741  77 58503 66506105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:28:26 [DEBUG   ] Got command RPT from MCS: ref #1230742
2019-01-20 18:28:26 [DEBUG   ] summary = ERROR
2019-01-20 18:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230742  13 58503 66506309 A  ERRORERROR'
2019-01-20 18:28:26 [DEBUG   ] Got command RPT from MCS: ref #1230744
2019-01-20 18:28:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230744  77 58503 66506513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:28:26 [DEBUG   ] Got command RPT from MCS: ref #1230745
2019-01-20 18:28:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 18:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230745  12 58503 66506717 A  ERRORB£ff'
2019-01-20 18:28:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:28:43 [DEBUG   ] Got command BAM from MCS: ref #1230754
2019-01-20 18:28:43 [INFO    ] Finished processing BAM request
2019-01-20 18:28:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230754   8 58503 66523033 A  ERROR'
2019-01-20 18:28:43 [DEBUG   ] Got command BAM from MCS: ref #1230755
2019-01-20 18:28:43 [INFO    ] Finished processing BAM request
2019-01-20 18:28:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230755   8 58503 66523037 A  ERROR'
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:28:43 [DEBUG   ] spawn_process: at 2019-01-20 18:28:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:28:59 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-20 18:29:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 18:29:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 18:29:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 18:29:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:29:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:29:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:29:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:29:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:29:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:29:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:29:08 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-20 18:29:15 [DEBUG   ] Got command BAM from MCS: ref #1230757
2019-01-20 18:29:15 [INFO    ] Finished processing BAM request
2019-01-20 18:29:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230757   8 58503 66555053 A  ERROR'
2019-01-20 18:29:15 [DEBUG   ] Got command BAM from MCS: ref #1230756
2019-01-20 18:29:15 [INFO    ] Finished processing BAM request
2019-01-20 18:29:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230756   8 58503 66555057 A  ERROR'
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:29:15 [DEBUG   ] spawn_process: at 2019-01-20 18:29:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:29:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 18:29:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 18:29:47 [DEBUG   ] Got command BAM from MCS: ref #1230759
2019-01-20 18:29:47 [INFO    ] Finished processing BAM request
2019-01-20 18:29:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230759   8 58503 66587029 A  ERROR'
2019-01-20 18:29:47 [DEBUG   ] Got command BAM from MCS: ref #1230758
2019-01-20 18:29:47 [INFO    ] Finished processing BAM request
2019-01-20 18:29:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230758   8 58503 66587033 A  ERROR'
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:29:47 [DEBUG   ] spawn_process: at 2019-01-20 18:29:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:30:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 18:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 18:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 18:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-20 18:30:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:30:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:30:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:30:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:30:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:30:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:30:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:30:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:30:08 [DEBUG   ] Finished updating board flags in 1.339 seconds
2019-01-20 18:30:19 [DEBUG   ] Got command BAM from MCS: ref #1230760
2019-01-20 18:30:19 [INFO    ] Finished processing BAM request
2019-01-20 18:30:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230760   8 58503 66619029 A  ERROR'
2019-01-20 18:30:19 [DEBUG   ] Got command BAM from MCS: ref #1230761
2019-01-20 18:30:19 [INFO    ] Finished processing BAM request
2019-01-20 18:30:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230761   8 58503 66619033 A  ERROR'
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:30:19 [DEBUG   ] spawn_process: at 2019-01-20 18:30:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:30:20 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2019-01-20 18:30:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 18:30:51 [DEBUG   ] Got command BAM from MCS: ref #1230762
2019-01-20 18:30:51 [INFO    ] Finished processing BAM request
2019-01-20 18:30:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:30:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230762   8 58503 66651033 A  ERROR'
2019-01-20 18:30:51 [DEBUG   ] Got command BAM from MCS: ref #1230763
2019-01-20 18:30:51 [INFO    ] Finished processing BAM request
2019-01-20 18:30:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:30:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230763   8 58503 66651037 A  ERROR'
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 18:30:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 18:30:51 [DEBUG   ] spawn_process: at 2019-01-20 18:30:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 18:31:00 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 18:31:06 [DEBUG   ] Got command RPT from MCS: ref #1230764
2019-01-20 18:31:06 [DEBUG   ] summary = ERROR
2019-01-20 18:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230764  13 58503 66666721 A  ERRORERROR'
2019-01-20 18:31:06 [DEBUG   ] Got command RPT from MCS: ref #1230765
2019-01-20 18:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230765  77 58503 66666722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:31:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 18:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-20 18:31:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:31:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:31:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:31:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:31:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:31:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:31:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:31:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:31:08 [DEBUG   ] Finished updating board flags in 1.216 seconds
2019-01-20 18:31:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:31:23 [DEBUG   ] Got command BAM from MCS: ref #1230782
2019-01-20 18:31:23 [INFO    ] Finished processing BAM request
2019-01-20 18:31:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:31:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230782   8 58503 66683034 A  ERROR'
2019-01-20 18:31:23 [DEBUG   ] Got command BAM from MCS: ref #1230781
2019-01-20 18:31:23 [INFO    ] Finished processing BAM request
2019-01-20 18:31:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:31:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230781   8 58503 66683038 A  ERROR'
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:31:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:31:23 [DEBUG   ] spawn_process: at 2019-01-20 18:31:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:31:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:31:55 [DEBUG   ] Got command BAM from MCS: ref #1230787
2019-01-20 18:31:55 [INFO    ] Finished processing BAM request
2019-01-20 18:31:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230787   8 58503 66715034 A  ERROR'
2019-01-20 18:31:55 [DEBUG   ] Got command BAM from MCS: ref #1230788
2019-01-20 18:31:55 [INFO    ] Finished processing BAM request
2019-01-20 18:31:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230788   8 58503 66715038 A  ERROR'
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:31:55 [DEBUG   ] spawn_process: at 2019-01-20 18:31:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:32:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 18:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 18:32:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:32:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:32:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:32:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:32:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:32:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:32:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:32:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:32:08 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-01-20 18:32:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:32:27 [DEBUG   ] Got command BAM from MCS: ref #1230790
2019-01-20 18:32:27 [INFO    ] Finished processing BAM request
2019-01-20 18:32:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230790   8 58503 66747034 A  ERROR'
2019-01-20 18:32:27 [DEBUG   ] Got command BAM from MCS: ref #1230789
2019-01-20 18:32:27 [INFO    ] Finished processing BAM request
2019-01-20 18:32:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230789   8 58503 66747038 A  ERROR'
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:32:27 [DEBUG   ] spawn_process: at 2019-01-20 18:32:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:32:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:32:59 [DEBUG   ] Got command BAM from MCS: ref #1230791
2019-01-20 18:32:59 [INFO    ] Finished processing BAM request
2019-01-20 18:32:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:32:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230791   8 58503 66779034 A  ERROR'
2019-01-20 18:32:59 [DEBUG   ] Got command BAM from MCS: ref #1230792
2019-01-20 18:32:59 [INFO    ] Finished processing BAM request
2019-01-20 18:32:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:32:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230792   8 58503 66779038 A  ERROR'
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:32:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:32:59 [DEBUG   ] spawn_process: at 2019-01-20 18:32:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:33:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 18:33:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 18:33:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:33:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:33:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:33:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:33:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:33:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:33:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:33:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:33:08 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-01-20 18:33:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 18:33:25 [DEBUG   ] Got command RPT from MCS: ref #1230793
2019-01-20 18:33:25 [DEBUG   ] summary = ERROR
2019-01-20 18:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230793  13 58503 66805990 A  ERRORERROR'
2019-01-20 18:33:26 [DEBUG   ] Got command RPT from MCS: ref #1230794
2019-01-20 18:33:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230794  77 58503 66806194 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:33:26 [DEBUG   ] Got command RPT from MCS: ref #1230795
2019-01-20 18:33:26 [DEBUG   ] summary = ERROR
2019-01-20 18:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230795  13 58503 66806397 A  ERRORERROR'
2019-01-20 18:33:26 [DEBUG   ] Got command RPT from MCS: ref #1230796
2019-01-20 18:33:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230796  77 58503 66806601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:33:26 [DEBUG   ] Got command RPT from MCS: ref #1230797
2019-01-20 18:33:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 18:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230797  12 58503 66806794 A  ERRORB¤ff'
2019-01-20 18:33:31 [DEBUG   ] Got command BAM from MCS: ref #1230799
2019-01-20 18:33:31 [INFO    ] Finished processing BAM request
2019-01-20 18:33:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230799   8 58503 66811034 A  ERROR'
2019-01-20 18:33:31 [DEBUG   ] Got command BAM from MCS: ref #1230798
2019-01-20 18:33:31 [INFO    ] Finished processing BAM request
2019-01-20 18:33:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230798   8 58503 66811038 A  ERROR'
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:33:31 [DEBUG   ] spawn_process: at 2019-01-20 18:33:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:33:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:34:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:34:04 [DEBUG   ] Got command BAM from MCS: ref #1230800
2019-01-20 18:34:04 [INFO    ] Finished processing BAM request
2019-01-20 18:34:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:34:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230800   8 58503 66844030 A  ERROR'
2019-01-20 18:34:04 [DEBUG   ] Got command BAM from MCS: ref #1230801
2019-01-20 18:34:04 [INFO    ] Finished processing BAM request
2019-01-20 18:34:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:34:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230801   8 58503 66844034 A  ERROR'
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:34:04 [DEBUG   ] spawn_process: at 2019-01-20 18:34:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 18:34:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 18:34:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:34:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:34:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 18:34:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:34:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:34:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:34:08 [WARNING ] (13, 1, 'bot')
2019-01-20 18:34:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:34:08 [DEBUG   ] Finished updating board flags in 1.271 seconds
2019-01-20 18:34:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 18:34:37 [DEBUG   ] Got command BAM from MCS: ref #1230807
2019-01-20 18:34:37 [INFO    ] Finished processing BAM request
2019-01-20 18:34:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:34:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230807   8 58503 66877033 A  ERROR'
2019-01-20 18:34:37 [DEBUG   ] Got command BAM from MCS: ref #1230806
2019-01-20 18:34:37 [INFO    ] Finished processing BAM request
2019-01-20 18:34:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:34:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230806   8 58503 66877037 A  ERROR'
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:34:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:34:37 [DEBUG   ] spawn_process: at 2019-01-20 18:34:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:34:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:35:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:35:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 18:35:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 18:35:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:35:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 18:35:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:35:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 18:35:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 18:35:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:35:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:35:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:35:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:35:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:35:09 [DEBUG   ] Finished updating board flags in 1.738 seconds
2019-01-20 18:35:10 [DEBUG   ] Got command BAM from MCS: ref #1230809
2019-01-20 18:35:10 [INFO    ] Finished processing BAM request
2019-01-20 18:35:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230809   8 58503 66910029 A  ERROR'
2019-01-20 18:35:10 [DEBUG   ] Got command BAM from MCS: ref #1230808
2019-01-20 18:35:10 [INFO    ] Finished processing BAM request
2019-01-20 18:35:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230808   8 58503 66910033 A  ERROR'
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 18:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 18:35:10 [DEBUG   ] spawn_process: at 2019-01-20 18:35:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 18:35:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 18:35:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 18:35:43 [DEBUG   ] Got command BAM from MCS: ref #1230811
2019-01-20 18:35:43 [INFO    ] Finished processing BAM request
2019-01-20 18:35:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:35:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230811   8 58503 66943033 A  ERROR'
2019-01-20 18:35:43 [DEBUG   ] Got command BAM from MCS: ref #1230810
2019-01-20 18:35:43 [INFO    ] Finished processing BAM request
2019-01-20 18:35:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:35:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230810   8 58503 66943037 A  ERROR'
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:35:43 [DEBUG   ] spawn_process: at 2019-01-20 18:35:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:36:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:36:06 [DEBUG   ] Got command RPT from MCS: ref #1230812
2019-01-20 18:36:06 [DEBUG   ] summary = ERROR
2019-01-20 18:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230812  13 58503 66966725 A  ERRORERROR'
2019-01-20 18:36:06 [DEBUG   ] Got command RPT from MCS: ref #1230813
2019-01-20 18:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230813  77 58503 66966726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:36:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 18:36:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:36:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:36:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:36:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:36:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:36:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:36:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:36:09 [DEBUG   ] Finished updating board flags in 1.628 seconds
2019-01-20 18:36:16 [DEBUG   ] Got command BAM from MCS: ref #1230830
2019-01-20 18:36:16 [INFO    ] Finished processing BAM request
2019-01-20 18:36:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:36:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230830   8 58503 66976033 A  ERROR'
2019-01-20 18:36:16 [DEBUG   ] Got command BAM from MCS: ref #1230829
2019-01-20 18:36:16 [INFO    ] Finished processing BAM request
2019-01-20 18:36:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:36:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230829   8 58503 66976037 A  ERROR'
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:36:16 [DEBUG   ] spawn_process: at 2019-01-20 18:36:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:36:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:36:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:36:49 [DEBUG   ] Got command BAM from MCS: ref #1230832
2019-01-20 18:36:49 [INFO    ] Finished processing BAM request
2019-01-20 18:36:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230832   8 58503 67009025 A  ERROR'
2019-01-20 18:36:49 [DEBUG   ] Got command BAM from MCS: ref #1230831
2019-01-20 18:36:49 [INFO    ] Finished processing BAM request
2019-01-20 18:36:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230831   8 58503 67009029 A  ERROR'
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:36:49 [DEBUG   ] spawn_process: at 2019-01-20 18:36:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:37:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 18:37:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 18:37:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 18:37:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:37:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 18:37:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:37:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:37:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:37:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:37:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:37:09 [DEBUG   ] Finished updating board flags in 1.571 seconds
2019-01-20 18:37:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 18:37:22 [DEBUG   ] Got command BAM from MCS: ref #1230834
2019-01-20 18:37:22 [INFO    ] Finished processing BAM request
2019-01-20 18:37:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230834   8 58503 67042033 A  ERROR'
2019-01-20 18:37:22 [DEBUG   ] Got command BAM from MCS: ref #1230833
2019-01-20 18:37:22 [INFO    ] Finished processing BAM request
2019-01-20 18:37:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230833   8 58503 67042037 A  ERROR'
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:37:22 [DEBUG   ] spawn_process: at 2019-01-20 18:37:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:37:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 18:37:55 [DEBUG   ] Got command BAM from MCS: ref #1230839
2019-01-20 18:37:55 [INFO    ] Finished processing BAM request
2019-01-20 18:37:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:37:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230839   8 58503 67075029 A  ERROR'
2019-01-20 18:37:55 [DEBUG   ] Got command BAM from MCS: ref #1230840
2019-01-20 18:37:55 [INFO    ] Finished processing BAM request
2019-01-20 18:37:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:37:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230840   8 58503 67075033 A  ERROR'
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:37:55 [DEBUG   ] spawn_process: at 2019-01-20 18:37:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:38:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 18:38:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 18:38:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:38:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:38:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:38:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:38:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:38:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:38:09 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-20 18:38:20 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-20 18:38:26 [DEBUG   ] Got command RPT from MCS: ref #1230843
2019-01-20 18:38:26 [DEBUG   ] summary = ERROR
2019-01-20 18:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230843  13 58503 67106077 A  ERRORERROR'
2019-01-20 18:38:26 [DEBUG   ] Got command RPT from MCS: ref #1230844
2019-01-20 18:38:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230844  77 58503 67106281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:38:26 [DEBUG   ] Got command RPT from MCS: ref #1230845
2019-01-20 18:38:26 [DEBUG   ] summary = ERROR
2019-01-20 18:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230845  13 58503 67106485 A  ERRORERROR'
2019-01-20 18:38:26 [DEBUG   ] Got command RPT from MCS: ref #1230847
2019-01-20 18:38:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230847  77 58503 67106677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:38:26 [DEBUG   ] Got command RPT from MCS: ref #1230849
2019-01-20 18:38:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 18:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230849  12 58503 67106881 A  ERRORB£ff'
2019-01-20 18:38:28 [DEBUG   ] Got command BAM from MCS: ref #1230850
2019-01-20 18:38:28 [INFO    ] Finished processing BAM request
2019-01-20 18:38:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230850   8 58503 67108025 A  ERROR'
2019-01-20 18:38:28 [DEBUG   ] Got command BAM from MCS: ref #1230851
2019-01-20 18:38:28 [INFO    ] Finished processing BAM request
2019-01-20 18:38:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230851   8 58503 67108029 A  ERROR'
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:38:28 [DEBUG   ] spawn_process: at 2019-01-20 18:38:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:38:41 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 18:39:01 [DEBUG   ] Got command BAM from MCS: ref #1230855
2019-01-20 18:39:01 [INFO    ] Finished processing BAM request
2019-01-20 18:39:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230855   8 58503 67141029 A  ERROR'
2019-01-20 18:39:01 [DEBUG   ] Got command BAM from MCS: ref #1230856
2019-01-20 18:39:01 [INFO    ] Finished processing BAM request
2019-01-20 18:39:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230856   8 58503 67141033 A  ERROR'
2019-01-20 18:39:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:39:01 [DEBUG   ] spawn_process: at 2019-01-20 18:39:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:39:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 18:39:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 18:39:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:39:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:39:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 18:39:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:39:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:39:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:39:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:39:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:39:09 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-01-20 18:39:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 18:39:34 [DEBUG   ] Got command BAM from MCS: ref #1230858
2019-01-20 18:39:34 [INFO    ] Finished processing BAM request
2019-01-20 18:39:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:39:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230858   8 58503 67174025 A  ERROR'
2019-01-20 18:39:34 [DEBUG   ] Got command BAM from MCS: ref #1230857
2019-01-20 18:39:34 [INFO    ] Finished processing BAM request
2019-01-20 18:39:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:39:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230857   8 58503 67174029 A  ERROR'
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 18:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 18:39:34 [DEBUG   ] spawn_process: at 2019-01-20 18:39:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 18:39:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 18:40:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 18:40:07 [DEBUG   ] Got command BAM from MCS: ref #1230860
2019-01-20 18:40:07 [INFO    ] Finished processing BAM request
2019-01-20 18:40:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230860   8 58503 67207029 A  ERROR'
2019-01-20 18:40:07 [DEBUG   ] Got command BAM from MCS: ref #1230859
2019-01-20 18:40:07 [INFO    ] Finished processing BAM request
2019-01-20 18:40:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230859   8 58503 67207033 A  ERROR'
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:40:07 [DEBUG   ] spawn_process: at 2019-01-20 18:40:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-20 18:40:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:40:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:40:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 18:40:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:40:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:40:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:40:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:40:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:40:09 [DEBUG   ] Finished updating board flags in 1.232 seconds
2019-01-20 18:40:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 18:40:40 [DEBUG   ] Got command BAM from MCS: ref #1230866
2019-01-20 18:40:40 [INFO    ] Finished processing BAM request
2019-01-20 18:40:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230866   8 58503 67240029 A  ERROR'
2019-01-20 18:40:40 [DEBUG   ] Got command BAM from MCS: ref #1230865
2019-01-20 18:40:40 [INFO    ] Finished processing BAM request
2019-01-20 18:40:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230865   8 58503 67240033 A  ERROR'
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:40:40 [DEBUG   ] spawn_process: at 2019-01-20 18:40:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:40:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:41:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:41:06 [DEBUG   ] Got command RPT from MCS: ref #1230867
2019-01-20 18:41:06 [DEBUG   ] summary = ERROR
2019-01-20 18:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230867  13 58503 67266729 A  ERRORERROR'
2019-01-20 18:41:06 [DEBUG   ] Got command RPT from MCS: ref #1230868
2019-01-20 18:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230868  77 58503 67266730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:41:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:41:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:41:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 18:41:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:41:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:41:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:41:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:41:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:41:09 [DEBUG   ] Finished updating board flags in 1.222 seconds
2019-01-20 18:41:13 [DEBUG   ] Got command BAM from MCS: ref #1230885
2019-01-20 18:41:13 [INFO    ] Finished processing BAM request
2019-01-20 18:41:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:41:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230885   8 58503 67273029 A  ERROR'
2019-01-20 18:41:13 [DEBUG   ] Got command BAM from MCS: ref #1230884
2019-01-20 18:41:13 [INFO    ] Finished processing BAM request
2019-01-20 18:41:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:41:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230884   8 58503 67273033 A  ERROR'
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 18:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 18:41:13 [DEBUG   ] spawn_process: at 2019-01-20 18:41:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 18:41:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:41:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:41:46 [DEBUG   ] Got command BAM from MCS: ref #1230887
2019-01-20 18:41:46 [INFO    ] Finished processing BAM request
2019-01-20 18:41:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230887   8 58503 67306033 A  ERROR'
2019-01-20 18:41:46 [DEBUG   ] Got command BAM from MCS: ref #1230886
2019-01-20 18:41:46 [INFO    ] Finished processing BAM request
2019-01-20 18:41:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230886   8 58503 67306037 A  ERROR'
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:41:46 [DEBUG   ] spawn_process: at 2019-01-20 18:41:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:42:01 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 18:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-20 18:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 18:42:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:42:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:42:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:42:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:42:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:42:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:42:09 [DEBUG   ] Finished updating board flags in 1.151 seconds
2019-01-20 18:42:19 [DEBUG   ] Got command BAM from MCS: ref #1230889
2019-01-20 18:42:19 [INFO    ] Finished processing BAM request
2019-01-20 18:42:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230889   8 58503 67339033 A  ERROR'
2019-01-20 18:42:19 [DEBUG   ] Got command BAM from MCS: ref #1230888
2019-01-20 18:42:19 [INFO    ] Finished processing BAM request
2019-01-20 18:42:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230888   8 58503 67339041 A  ERROR'
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:42:19 [DEBUG   ] spawn_process: at 2019-01-20 18:42:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:42:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:42:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:42:52 [DEBUG   ] Got command BAM from MCS: ref #1230891
2019-01-20 18:42:52 [INFO    ] Finished processing BAM request
2019-01-20 18:42:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:42:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230891   8 58503 67372029 A  ERROR'
2019-01-20 18:42:52 [DEBUG   ] Got command BAM from MCS: ref #1230890
2019-01-20 18:42:52 [INFO    ] Finished processing BAM request
2019-01-20 18:42:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:42:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230890   8 58503 67372033 A  ERROR'
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 18:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 18:42:52 [DEBUG   ] spawn_process: at 2019-01-20 18:42:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 18:43:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-20 18:43:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:43:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:43:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:43:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:43:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:43:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:43:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:43:09 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-20 18:43:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:43:25 [DEBUG   ] Got command BAM from MCS: ref #1230893
2019-01-20 18:43:25 [INFO    ] Finished processing BAM request
2019-01-20 18:43:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230893   8 58503 67405029 A  ERROR'
2019-01-20 18:43:25 [DEBUG   ] Got command BAM from MCS: ref #1230892
2019-01-20 18:43:25 [INFO    ] Finished processing BAM request
2019-01-20 18:43:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230892   8 58503 67405037 A  ERROR'
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 18:43:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 18:43:25 [DEBUG   ] spawn_process: at 2019-01-20 18:43:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 18:43:26 [DEBUG   ] Got command RPT from MCS: ref #1230894
2019-01-20 18:43:26 [DEBUG   ] summary = ERROR
2019-01-20 18:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230894  13 58503 67406169 A  ERRORERROR'
2019-01-20 18:43:26 [DEBUG   ] Got command RPT from MCS: ref #1230895
2019-01-20 18:43:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230895  77 58503 67406373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:43:26 [DEBUG   ] Got command RPT from MCS: ref #1230896
2019-01-20 18:43:26 [DEBUG   ] summary = ERROR
2019-01-20 18:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230896  13 58503 67406565 A  ERRORERROR'
2019-01-20 18:43:26 [DEBUG   ] Got command RPT from MCS: ref #1230897
2019-01-20 18:43:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230897  77 58503 67406769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:43:26 [DEBUG   ] Got command RPT from MCS: ref #1230898
2019-01-20 18:43:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 18:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230898  12 58503 67406973 A  ERRORB£ff'
2019-01-20 18:43:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:43:59 [DEBUG   ] Got command BAM from MCS: ref #1230903
2019-01-20 18:43:59 [INFO    ] Finished processing BAM request
2019-01-20 18:43:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230903   8 58503 67439033 A  ERROR'
2019-01-20 18:43:59 [DEBUG   ] Got command BAM from MCS: ref #1230904
2019-01-20 18:43:59 [INFO    ] Finished processing BAM request
2019-01-20 18:43:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230904   8 58503 67439037 A  ERROR'
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 18:43:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 18:43:59 [DEBUG   ] spawn_process: at 2019-01-20 18:43:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 18:44:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:44:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 18:44:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:44:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:44:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:44:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:44:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:44:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:44:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:44:09 [DEBUG   ] Finished updating board flags in 0.992 seconds
2019-01-20 18:44:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:44:33 [DEBUG   ] Got command BAM from MCS: ref #1230905
2019-01-20 18:44:33 [INFO    ] Finished processing BAM request
2019-01-20 18:44:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:44:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230905   8 58503 67473033 A  ERROR'
2019-01-20 18:44:33 [DEBUG   ] Got command BAM from MCS: ref #1230906
2019-01-20 18:44:33 [INFO    ] Finished processing BAM request
2019-01-20 18:44:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:44:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230906   8 58503 67473037 A  ERROR'
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 18:44:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 18:44:33 [DEBUG   ] spawn_process: at 2019-01-20 18:44:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 18:44:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 18:45:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 18:45:07 [DEBUG   ] Got command BAM from MCS: ref #1230908
2019-01-20 18:45:07 [INFO    ] Finished processing BAM request
2019-01-20 18:45:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230908   8 58503 67507029 A  ERROR'
2019-01-20 18:45:07 [DEBUG   ] Got command BAM from MCS: ref #1230907
2019-01-20 18:45:07 [INFO    ] Finished processing BAM request
2019-01-20 18:45:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230907   8 58503 67507033 A  ERROR'
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 18:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 18:45:07 [DEBUG   ] spawn_process: at 2019-01-20 18:45:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 18:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 18:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 18:45:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:45:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 18:45:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 18:45:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 18:45:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:45:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:45:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:45:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:45:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:45:10 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-01-20 18:45:22 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-01-20 18:45:41 [DEBUG   ] Got command BAM from MCS: ref #1230909
2019-01-20 18:45:41 [INFO    ] Finished processing BAM request
2019-01-20 18:45:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:45:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230909   8 58503 67541033 A  ERROR'
2019-01-20 18:45:41 [DEBUG   ] Got command BAM from MCS: ref #1230910
2019-01-20 18:45:41 [INFO    ] Finished processing BAM request
2019-01-20 18:45:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:45:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230910   8 58503 67541037 A  ERROR'
2019-01-20 18:45:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:45:41 [DEBUG   ] spawn_process: at 2019-01-20 18:45:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:46:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:46:06 [DEBUG   ] Got command RPT from MCS: ref #1230911
2019-01-20 18:46:06 [DEBUG   ] summary = ERROR
2019-01-20 18:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230911  13 58503 67566721 A  ERRORERROR'
2019-01-20 18:46:06 [DEBUG   ] Got command RPT from MCS: ref #1230912
2019-01-20 18:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230912  77 58503 67566722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 18:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 18:46:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:46:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 18:46:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:46:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:46:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:46:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:46:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:46:09 [DEBUG   ] Finished updating board flags in 1.060 seconds
2019-01-20 18:46:15 [DEBUG   ] Got command BAM from MCS: ref #1230929
2019-01-20 18:46:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:46:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230929   8 58503 67575037 A  ERROR'
2019-01-20 18:46:15 [DEBUG   ] Got command BAM from MCS: ref #1230928
2019-01-20 18:46:15 [INFO    ] Finished processing BAM request
2019-01-20 18:46:15 [INFO    ] Finished processing BAM request
2019-01-20 18:46:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 18:46:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1230928   8 58503 67575045 A  ERROR'
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:46:15 [DEBUG   ] spawn_process: at 2019-01-20 18:46:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:46:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:46:39 [DEBUG   ] Got command STP from MCS: ref #1230935
2019-01-20 18:46:39 [INFO    ] Finished processing BAM request
2019-01-20 18:46:39 [INFO    ] Shutdown the adder chain on beam #3
2019-01-20 18:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1230935   8 58503 67599025 A  ERROR'
2019-01-20 18:46:39 [DEBUG   ] Got command STP from MCS: ref #1230934
2019-01-20 18:46:39 [INFO    ] Finished processing BAM request
2019-01-20 18:46:39 [INFO    ] Shutdown the adder chain on beam #2
2019-01-20 18:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1230934   8 58503 67599029 A  ERROR'
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 18:46:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 18:46:39 [DEBUG   ] spawn_process: at 2019-01-20 18:46:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 18:46:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:47:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 18:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 18:47:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:47:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:47:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:47:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:47:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:47:09 [DEBUG   ] Finished updating board flags in 1.058 seconds
2019-01-20 18:47:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:47:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:48:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 18:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 18:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:48:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:48:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:48:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:48:09 [WARNING ] (13, 1, 'bot')
2019-01-20 18:48:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:48:09 [DEBUG   ] Finished updating board flags in 0.963 seconds
2019-01-20 18:48:21 [DEBUG   ] Finished updating ant stats in 0.387 seconds
2019-01-20 18:48:26 [DEBUG   ] Got command RPT from MCS: ref #1230938
2019-01-20 18:48:26 [DEBUG   ] summary = ERROR
2019-01-20 18:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230938  13 58503 67706257 A  ERRORERROR'
2019-01-20 18:48:26 [DEBUG   ] Got command RPT from MCS: ref #1230939
2019-01-20 18:48:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230939  77 58503 67706450 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:48:26 [DEBUG   ] Got command RPT from MCS: ref #1230940
2019-01-20 18:48:26 [DEBUG   ] summary = ERROR
2019-01-20 18:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230940  13 58503 67706653 A  ERRORERROR'
2019-01-20 18:48:26 [DEBUG   ] Got command RPT from MCS: ref #1230942
2019-01-20 18:48:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230942  77 58503 67706857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:48:27 [DEBUG   ] Got command RPT from MCS: ref #1230943
2019-01-20 18:48:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 18:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230943  12 58503 67707061 A  ERRORBœ™š'
2019-01-20 18:48:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 18:49:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 18:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:49:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 18:49:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:49:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:49:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:49:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:49:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:49:10 [DEBUG   ] Finished updating board flags in 1.353 seconds
2019-01-20 18:49:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 18:49:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 18:50:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 18:50:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:50:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:50:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:50:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:50:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:50:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:50:10 [DEBUG   ] Finished updating board flags in 1.170 seconds
2019-01-20 18:50:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 18:50:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 18:51:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 18:51:06 [DEBUG   ] Got command RPT from MCS: ref #1230952
2019-01-20 18:51:06 [DEBUG   ] summary = ERROR
2019-01-20 18:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230952  13 58503 67866721 A  ERRORERROR'
2019-01-20 18:51:06 [DEBUG   ] Got command RPT from MCS: ref #1230953
2019-01-20 18:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230953  77 58503 67866722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:51:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 18:51:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:51:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:51:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:51:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:51:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:51:10 [DEBUG   ] Finished updating board flags in 1.014 seconds
2019-01-20 18:51:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 18:51:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 18:52:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 18:52:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:52:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:52:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:52:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:52:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:52:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:52:10 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-20 18:52:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 18:52:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 18:53:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:53:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:53:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:53:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:53:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:53:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:53:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:53:10 [DEBUG   ] Finished updating board flags in 0.986 seconds
2019-01-20 18:53:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:53:26 [DEBUG   ] Got command RPT from MCS: ref #1230973
2019-01-20 18:53:26 [DEBUG   ] summary = ERROR
2019-01-20 18:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230973  13 58503 68006337 A  ERRORERROR'
2019-01-20 18:53:26 [DEBUG   ] Got command RPT from MCS: ref #1230974
2019-01-20 18:53:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230974  77 58503 68006541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:53:26 [DEBUG   ] Got command RPT from MCS: ref #1230975
2019-01-20 18:53:26 [DEBUG   ] summary = ERROR
2019-01-20 18:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230975  13 58503 68006733 A  ERRORERROR'
2019-01-20 18:53:26 [DEBUG   ] Got command RPT from MCS: ref #1230976
2019-01-20 18:53:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230976  77 58503 68006937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:53:27 [DEBUG   ] Got command RPT from MCS: ref #1230977
2019-01-20 18:53:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 18:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230977  12 58503 68007141 A  ERRORB˜™š'
2019-01-20 18:53:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:54:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:54:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:54:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:54:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:54:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:54:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:54:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:54:11 [DEBUG   ] Finished updating board flags in 1.832 seconds
2019-01-20 18:54:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:54:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:55:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:55:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:55:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 18:55:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:55:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:55:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:55:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:55:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:55:11 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-20 18:55:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:55:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:56:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:56:06 [DEBUG   ] Got command RPT from MCS: ref #1230982
2019-01-20 18:56:06 [DEBUG   ] summary = ERROR
2019-01-20 18:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230982  13 58503 68166725 A  ERRORERROR'
2019-01-20 18:56:06 [DEBUG   ] Got command RPT from MCS: ref #1230983
2019-01-20 18:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1230983  77 58503 68166726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:56:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:56:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:56:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:56:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:56:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:56:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:56:10 [DEBUG   ] Finished updating board flags in 1.245 seconds
2019-01-20 18:56:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:56:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:57:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:57:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 18:57:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:57:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:57:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:57:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:57:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:57:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:57:11 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-20 18:57:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:57:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:58:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 18:58:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:58:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:58:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:58:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:58:10 [WARNING ] (13, 1, 'bot')
2019-01-20 18:58:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:58:10 [DEBUG   ] Finished updating board flags in 0.981 seconds
2019-01-20 18:58:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:58:26 [DEBUG   ] Got command RPT from MCS: ref #1231001
2019-01-20 18:58:26 [DEBUG   ] summary = ERROR
2019-01-20 18:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231001  13 58503 68306421 A  ERRORERROR'
2019-01-20 18:58:26 [DEBUG   ] Got command RPT from MCS: ref #1231002
2019-01-20 18:58:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231002  77 58503 68306625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:58:26 [DEBUG   ] Got command RPT from MCS: ref #1231003
2019-01-20 18:58:26 [DEBUG   ] summary = ERROR
2019-01-20 18:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231003  13 58503 68306829 A  ERRORERROR'
2019-01-20 18:58:27 [DEBUG   ] Got command RPT from MCS: ref #1231005
2019-01-20 18:58:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 18:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231005  77 58503 68307021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 18:58:27 [DEBUG   ] Got command RPT from MCS: ref #1231006
2019-01-20 18:58:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 18:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231006  12 58503 68307225 A  ERRORB˜™š'
2019-01-20 18:58:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:59:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:59:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 18:59:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:59:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:59:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:59:11 [WARNING ] (13, 1, 'bot')
2019-01-20 18:59:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 18:59:11 [DEBUG   ] Finished updating board flags in 1.367 seconds
2019-01-20 18:59:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 18:59:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:00:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:00:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:00:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:00:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:00:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:00:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:00:11 [DEBUG   ] Finished updating board flags in 1.220 seconds
2019-01-20 19:00:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 19:00:28 [DEBUG   ] Got command DRX from MCS: ref #1231020
2019-01-20 19:00:28 [INFO    ] sending drx command to lwa16
2019-01-20 19:00:28 [DEBUG   ] run_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 64500000.0 7 9 0']
2019-01-20 19:00:28 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-20 19:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1231020   8 58503 68428006 A  ERROR'
2019-01-20 19:00:28 [DEBUG   ] Got command DRX from MCS: ref #1231019
2019-01-20 19:00:28 [INFO    ] sending drx command to lwa34
2019-01-20 19:00:28 [DEBUG   ] run_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 0']
2019-01-20 19:00:28 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-20 19:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1231019   8 58503 68428010 A  ERROR'
2019-01-20 19:00:28 [DEBUG   ] Got command DRX from MCS: ref #1231021
2019-01-20 19:00:28 [INFO    ] sending drx command to lwa34
2019-01-20 19:00:28 [DEBUG   ] run_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 0']
2019-01-20 19:00:28 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-20 19:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1231021   8 58503 68428014 A  ERROR'
2019-01-20 19:00:28 [DEBUG   ] Got command DRX from MCS: ref #1231022
2019-01-20 19:00:28 [INFO    ] sending drx command to lwa16
2019-01-20 19:00:28 [DEBUG   ] run_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 79200000.0 7 9 0']
2019-01-20 19:00:28 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-20 19:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1231022   8 58503 68428018 A  ERROR'
2019-01-20 19:00:28 [DEBUG   ] Got command BAM from MCS: ref #1231023
2019-01-20 19:00:28 [INFO    ] Finished processing BAM request
2019-01-20 19:00:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231023   8 58503 68428033 A  ERROR'
2019-01-20 19:00:28 [DEBUG   ] Got command BAM from MCS: ref #1231024
2019-01-20 19:00:28 [INFO    ] Finished processing BAM request
2019-01-20 19:00:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231024   8 58503 68428037 A  ERROR'
2019-01-20 19:00:28 [INFO    ] Finished starting DRX
2019-01-20 19:00:28 [INFO    ] Finished starting DRX
2019-01-20 19:00:28 [INFO    ] Finished starting DRX
2019-01-20 19:00:28 [INFO    ] Finished starting DRX
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:00:28 [DEBUG   ] spawn_process: at 2019-01-20 19:00:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:00:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 19:01:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:01:06 [DEBUG   ] Got command RPT from MCS: ref #1231027
2019-01-20 19:01:06 [DEBUG   ] summary = ERROR
2019-01-20 19:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231027  13 58503 68466729 A  ERRORERROR'
2019-01-20 19:01:06 [DEBUG   ] Got command RPT from MCS: ref #1231028
2019-01-20 19:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231028  77 58503 68466730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:01:09 [DEBUG   ] Got command BAM from MCS: ref #1231045
2019-01-20 19:01:09 [INFO    ] Finished processing BAM request
2019-01-20 19:01:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:01:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231045   8 58503 68469025 A  ERROR'
2019-01-20 19:01:09 [DEBUG   ] Got command BAM from MCS: ref #1231044
2019-01-20 19:01:09 [INFO    ] Finished processing BAM request
2019-01-20 19:01:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:01:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231044   8 58503 68469029 A  ERROR'
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:01:09 [DEBUG   ] spawn_process: at 2019-01-20 19:01:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 19:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:01:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:01:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:01:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:01:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:01:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:01:11 [DEBUG   ] Finished updating board flags in 1.166 seconds
2019-01-20 19:01:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 19:01:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:01:50 [DEBUG   ] Got command BAM from MCS: ref #1231050
2019-01-20 19:01:50 [INFO    ] Finished processing BAM request
2019-01-20 19:01:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231050   8 58503 68510029 A  ERROR'
2019-01-20 19:01:50 [DEBUG   ] Got command BAM from MCS: ref #1231051
2019-01-20 19:01:50 [INFO    ] Finished processing BAM request
2019-01-20 19:01:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231051   8 58503 68510033 A  ERROR'
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:01:50 [DEBUG   ] spawn_process: at 2019-01-20 19:01:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:02:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:02:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:02:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:02:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:02:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:02:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:02:11 [DEBUG   ] Finished updating board flags in 1.029 seconds
2019-01-20 19:02:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:02:31 [DEBUG   ] Got command BAM from MCS: ref #1231053
2019-01-20 19:02:31 [INFO    ] Finished processing BAM request
2019-01-20 19:02:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231053   8 58503 68551029 A  ERROR'
2019-01-20 19:02:31 [DEBUG   ] Got command BAM from MCS: ref #1231052
2019-01-20 19:02:31 [INFO    ] Finished processing BAM request
2019-01-20 19:02:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231052   8 58503 68551033 A  ERROR'
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:02:31 [DEBUG   ] spawn_process: at 2019-01-20 19:02:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:02:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:03:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:03:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:03:12 [DEBUG   ] Got command BAM from MCS: ref #1231054
2019-01-20 19:03:12 [INFO    ] Finished processing BAM request
2019-01-20 19:03:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:03:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231054   8 58503 68592037 A  ERROR'
2019-01-20 19:03:12 [DEBUG   ] Got command BAM from MCS: ref #1231055
2019-01-20 19:03:12 [INFO    ] Finished processing BAM request
2019-01-20 19:03:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:03:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231055   8 58503 68592045 A  ERROR'
2019-01-20 19:03:12 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:03:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:03:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:03:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:03:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:03:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:03:12 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:03:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:03:12 [DEBUG   ] spawn_process: at 2019-01-20 19:03:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:03:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:03:26 [DEBUG   ] Got command RPT from MCS: ref #1231056
2019-01-20 19:03:26 [DEBUG   ] summary = ERROR
2019-01-20 19:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231056  13 58503 68606509 A  ERRORERROR'
2019-01-20 19:03:26 [DEBUG   ] Got command RPT from MCS: ref #1231057
2019-01-20 19:03:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231057  77 58503 68606713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:03:26 [DEBUG   ] Got command RPT from MCS: ref #1231058
2019-01-20 19:03:26 [DEBUG   ] summary = ERROR
2019-01-20 19:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231058  13 58503 68606909 A  ERRORERROR'
2019-01-20 19:03:27 [DEBUG   ] Got command RPT from MCS: ref #1231059
2019-01-20 19:03:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231059  77 58503 68607113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:03:27 [DEBUG   ] Got command RPT from MCS: ref #1231060
2019-01-20 19:03:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 19:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231060  12 58503 68607317 A  ERRORB ff'
2019-01-20 19:03:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:03:53 [DEBUG   ] Got command BAM from MCS: ref #1231062
2019-01-20 19:03:53 [INFO    ] Finished processing BAM request
2019-01-20 19:03:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:03:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231062   8 58503 68633037 A  ERROR'
2019-01-20 19:03:53 [DEBUG   ] Got command BAM from MCS: ref #1231061
2019-01-20 19:03:53 [INFO    ] Finished processing BAM request
2019-01-20 19:03:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:03:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231061   8 58503 68633041 A  ERROR'
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:03:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:03:53 [DEBUG   ] spawn_process: at 2019-01-20 19:03:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:04:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:04:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 19:04:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 19:04:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:04:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:04:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:04:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:04:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:04:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:04:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:04:12 [DEBUG   ] Finished updating board flags in 2.047 seconds
2019-01-20 19:04:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:04:34 [DEBUG   ] Got command BAM from MCS: ref #1231063
2019-01-20 19:04:34 [INFO    ] Finished processing BAM request
2019-01-20 19:04:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:04:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231063   8 58503 68674033 A  ERROR'
2019-01-20 19:04:34 [DEBUG   ] Got command BAM from MCS: ref #1231064
2019-01-20 19:04:34 [INFO    ] Finished processing BAM request
2019-01-20 19:04:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:04:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231064   8 58503 68674037 A  ERROR'
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:04:34 [DEBUG   ] spawn_process: at 2019-01-20 19:04:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:04:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 19:05:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 19:05:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 19:05:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:05:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:05:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 19:05:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:05:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 19:05:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:05:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:05:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:05:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:05:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:05:11 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-01-20 19:05:15 [DEBUG   ] Got command BAM from MCS: ref #1231070
2019-01-20 19:05:15 [INFO    ] Finished processing BAM request
2019-01-20 19:05:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231070   8 58503 68715025 A  ERROR'
2019-01-20 19:05:15 [DEBUG   ] Got command BAM from MCS: ref #1231069
2019-01-20 19:05:15 [INFO    ] Finished processing BAM request
2019-01-20 19:05:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231069   8 58503 68715029 A  ERROR'
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:05:15 [DEBUG   ] spawn_process: at 2019-01-20 19:05:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:05:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:05:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:05:56 [DEBUG   ] Got command BAM from MCS: ref #1231072
2019-01-20 19:05:56 [INFO    ] Finished processing BAM request
2019-01-20 19:05:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:05:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231072   8 58503 68756029 A  ERROR'
2019-01-20 19:05:56 [DEBUG   ] Got command BAM from MCS: ref #1231071
2019-01-20 19:05:56 [INFO    ] Finished processing BAM request
2019-01-20 19:05:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:05:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231071   8 58503 68756033 A  ERROR'
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:05:56 [DEBUG   ] spawn_process: at 2019-01-20 19:05:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:06:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 19:06:06 [DEBUG   ] Got command RPT from MCS: ref #1231073
2019-01-20 19:06:06 [DEBUG   ] summary = ERROR
2019-01-20 19:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231073  13 58503 68766729 A  ERRORERROR'
2019-01-20 19:06:06 [DEBUG   ] Got command RPT from MCS: ref #1231074
2019-01-20 19:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231074  77 58503 68766730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:06:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 19:06:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:06:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 19:06:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:06:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:06:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:06:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:06:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:06:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:06:11 [DEBUG   ] Finished updating board flags in 1.225 seconds
2019-01-20 19:06:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:06:37 [DEBUG   ] Got command BAM from MCS: ref #1231091
2019-01-20 19:06:37 [INFO    ] Finished processing BAM request
2019-01-20 19:06:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231091   8 58503 68797025 A  ERROR'
2019-01-20 19:06:37 [DEBUG   ] Got command BAM from MCS: ref #1231090
2019-01-20 19:06:37 [INFO    ] Finished processing BAM request
2019-01-20 19:06:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231090   8 58503 68797029 A  ERROR'
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:06:37 [DEBUG   ] spawn_process: at 2019-01-20 19:06:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:06:42 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-20 19:07:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 19:07:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 19:07:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:07:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:07:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 19:07:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:07:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:07:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:07:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:07:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:07:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:07:11 [DEBUG   ] Finished updating board flags in 1.184 seconds
2019-01-20 19:07:18 [DEBUG   ] Got command BAM from MCS: ref #1231093
2019-01-20 19:07:18 [INFO    ] Finished processing BAM request
2019-01-20 19:07:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231093   8 58503 68838029 A  ERROR'
2019-01-20 19:07:18 [DEBUG   ] Got command BAM from MCS: ref #1231092
2019-01-20 19:07:18 [INFO    ] Finished processing BAM request
2019-01-20 19:07:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231092   8 58503 68838033 A  ERROR'
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 19:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 19:07:18 [DEBUG   ] spawn_process: at 2019-01-20 19:07:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 19:07:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 19:07:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 19:07:59 [DEBUG   ] Got command BAM from MCS: ref #1231099
2019-01-20 19:07:59 [INFO    ] Finished processing BAM request
2019-01-20 19:07:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:07:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231099   8 58503 68879029 A  ERROR'
2019-01-20 19:07:59 [DEBUG   ] Got command BAM from MCS: ref #1231098
2019-01-20 19:07:59 [INFO    ] Finished processing BAM request
2019-01-20 19:07:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:07:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231098   8 58503 68879033 A  ERROR'
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:07:59 [DEBUG   ] spawn_process: at 2019-01-20 19:07:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:08:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 19:08:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 19:08:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 19:08:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 19:08:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:08:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:08:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:08:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:08:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:08:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:08:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:08:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:08:11 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-01-20 19:08:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 19:08:26 [DEBUG   ] Got command RPT from MCS: ref #1231102
2019-01-20 19:08:26 [DEBUG   ] summary = ERROR
2019-01-20 19:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231102  13 58503 68906593 A  ERRORERROR'
2019-01-20 19:08:26 [DEBUG   ] Got command RPT from MCS: ref #1231103
2019-01-20 19:08:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231103  77 58503 68906797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:08:26 [DEBUG   ] Got command RPT from MCS: ref #1231104
2019-01-20 19:08:26 [DEBUG   ] summary = ERROR
2019-01-20 19:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231104  13 58503 68906989 A  ERRORERROR'
2019-01-20 19:08:27 [DEBUG   ] Got command RPT from MCS: ref #1231106
2019-01-20 19:08:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231106  77 58503 68907193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:08:27 [DEBUG   ] Got command RPT from MCS: ref #1231107
2019-01-20 19:08:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 19:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231107  12 58503 68907397 A  ERRORB£ff'
2019-01-20 19:08:40 [DEBUG   ] Got command BAM from MCS: ref #1231113
2019-01-20 19:08:40 [INFO    ] Finished processing BAM request
2019-01-20 19:08:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231113   8 58503 68920029 A  ERROR'
2019-01-20 19:08:40 [DEBUG   ] Got command BAM from MCS: ref #1231112
2019-01-20 19:08:40 [INFO    ] Finished processing BAM request
2019-01-20 19:08:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231112   8 58503 68920033 A  ERROR'
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:08:40 [DEBUG   ] spawn_process: at 2019-01-20 19:08:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:08:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 19:09:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:09:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:09:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:09:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:09:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2019-01-20 19:09:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:09:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:09:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:09:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:09:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:09:11 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-20 19:09:21 [DEBUG   ] Got command BAM from MCS: ref #1231114
2019-01-20 19:09:21 [INFO    ] Finished processing BAM request
2019-01-20 19:09:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:09:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231114   8 58503 68961033 A  ERROR'
2019-01-20 19:09:21 [DEBUG   ] Got command BAM from MCS: ref #1231115
2019-01-20 19:09:21 [INFO    ] Finished processing BAM request
2019-01-20 19:09:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:09:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231115   8 58503 68961037 A  ERROR'
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:09:21 [DEBUG   ] spawn_process: at 2019-01-20 19:09:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:09:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 19:09:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 19:10:02 [DEBUG   ] Got command BAM from MCS: ref #1231116
2019-01-20 19:10:02 [INFO    ] Finished processing BAM request
2019-01-20 19:10:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231116   8 58503 69002033 A  ERROR'
2019-01-20 19:10:02 [DEBUG   ] Got command BAM from MCS: ref #1231117
2019-01-20 19:10:02 [INFO    ] Finished processing BAM request
2019-01-20 19:10:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231117   8 58503 69002037 A  ERROR'
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 19:10:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 19:10:02 [DEBUG   ] spawn_process: at 2019-01-20 19:10:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 19:10:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 19:10:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 19:10:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 19:10:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:10:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-01-20 19:10:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:10:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 19:10:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-01-20 19:10:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:10:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:10:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:10:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:10:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:10:11 [DEBUG   ] Finished updating board flags in 1.004 seconds
2019-01-20 19:10:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:10:43 [DEBUG   ] Got command BAM from MCS: ref #1231123
2019-01-20 19:10:43 [INFO    ] Finished processing BAM request
2019-01-20 19:10:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:10:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231123   8 58503 69043033 A  ERROR'
2019-01-20 19:10:43 [DEBUG   ] Got command BAM from MCS: ref #1231122
2019-01-20 19:10:43 [INFO    ] Finished processing BAM request
2019-01-20 19:10:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:10:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231122   8 58503 69043037 A  ERROR'
2019-01-20 19:10:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:10:43 [DEBUG   ] spawn_process: at 2019-01-20 19:10:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:11:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:11:06 [DEBUG   ] Got command RPT from MCS: ref #1231124
2019-01-20 19:11:06 [DEBUG   ] summary = ERROR
2019-01-20 19:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231124  13 58503 69066729 A  ERRORERROR'
2019-01-20 19:11:06 [DEBUG   ] Got command RPT from MCS: ref #1231125
2019-01-20 19:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231125  77 58503 69066730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:11:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 19:11:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:11:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:11:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:11:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:11:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:11:11 [WARNING ] (13, 1, 'bot')
2019-01-20 19:11:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:11:11 [DEBUG   ] Finished updating board flags in 0.976 seconds
2019-01-20 19:11:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:11:24 [DEBUG   ] Got command BAM from MCS: ref #1231142
2019-01-20 19:11:24 [INFO    ] Finished processing BAM request
2019-01-20 19:11:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:11:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231142   8 58503 69084033 A  ERROR'
2019-01-20 19:11:24 [DEBUG   ] Got command BAM from MCS: ref #1231141
2019-01-20 19:11:24 [INFO    ] Finished processing BAM request
2019-01-20 19:11:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:11:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231141   8 58503 69084037 A  ERROR'
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:11:24 [DEBUG   ] spawn_process: at 2019-01-20 19:11:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:11:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 19:12:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:12:05 [DEBUG   ] Got command BAM from MCS: ref #1231144
2019-01-20 19:12:05 [INFO    ] Finished processing BAM request
2019-01-20 19:12:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:12:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231144   8 58503 69125029 A  ERROR'
2019-01-20 19:12:05 [DEBUG   ] Got command BAM from MCS: ref #1231143
2019-01-20 19:12:05 [INFO    ] Finished processing BAM request
2019-01-20 19:12:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:12:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231143   8 58503 69125033 A  ERROR'
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 19:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 19:12:05 [DEBUG   ] spawn_process: at 2019-01-20 19:12:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 19:12:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 19:12:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:12:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-20 19:12:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:12:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:12:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:12:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:12:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:12:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:12:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:12:12 [DEBUG   ] Finished updating board flags in 1.352 seconds
2019-01-20 19:12:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 19:12:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 19:12:46 [DEBUG   ] Got command BAM from MCS: ref #1231146
2019-01-20 19:12:46 [INFO    ] Finished processing BAM request
2019-01-20 19:12:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:12:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231146   8 58503 69166025 A  ERROR'
2019-01-20 19:12:46 [DEBUG   ] Got command BAM from MCS: ref #1231145
2019-01-20 19:12:46 [INFO    ] Finished processing BAM request
2019-01-20 19:12:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:12:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231145   8 58503 69166029 A  ERROR'
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:12:46 [DEBUG   ] spawn_process: at 2019-01-20 19:12:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:13:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:13:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:13:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 19:13:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:13:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:13:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:13:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:13:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:13:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:13:12 [DEBUG   ] Finished updating board flags in 1.257 seconds
2019-01-20 19:13:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:13:26 [DEBUG   ] Got command BAM from MCS: ref #1231147
2019-01-20 19:13:26 [INFO    ] Finished processing BAM request
2019-01-20 19:13:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231147   8 58503 69206025 A  ERROR'
2019-01-20 19:13:26 [DEBUG   ] Got command BAM from MCS: ref #1231148
2019-01-20 19:13:26 [INFO    ] Finished processing BAM request
2019-01-20 19:13:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231148   8 58503 69206029 A  ERROR'
2019-01-20 19:13:26 [DEBUG   ] Got command RPT from MCS: ref #1231149
2019-01-20 19:13:26 [DEBUG   ] summary = ERROR
2019-01-20 19:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231149  13 58503 69206677 A  ERRORERROR'
2019-01-20 19:13:26 [DEBUG   ] Got command RPT from MCS: ref #1231150
2019-01-20 19:13:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231150  77 58503 69206881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:13:26 [DEBUG   ] spawn_process: at 2019-01-20 19:13:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:13:27 [DEBUG   ] Got command RPT from MCS: ref #1231151
2019-01-20 19:13:27 [DEBUG   ] summary = ERROR
2019-01-20 19:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231151  13 58503 69207081 A  ERRORERROR'
2019-01-20 19:13:27 [DEBUG   ] Got command RPT from MCS: ref #1231152
2019-01-20 19:13:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231152  77 58503 69207285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:13:27 [DEBUG   ] Got command RPT from MCS: ref #1231153
2019-01-20 19:13:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 19:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231153  12 58503 69207477 A  ERRORB£ff'
2019-01-20 19:13:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 19:14:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:14:06 [DEBUG   ] Got command BAM from MCS: ref #1231158
2019-01-20 19:14:06 [INFO    ] Finished processing BAM request
2019-01-20 19:14:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231158   8 58503 69246025 A  ERROR'
2019-01-20 19:14:06 [DEBUG   ] Got command BAM from MCS: ref #1231159
2019-01-20 19:14:06 [INFO    ] Finished processing BAM request
2019-01-20 19:14:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231159   8 58503 69246029 A  ERROR'
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:14:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:14:06 [DEBUG   ] spawn_process: at 2019-01-20 19:14:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:14:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:14:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:14:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:14:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:14:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:14:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:14:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:14:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:14:12 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-01-20 19:14:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:14:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 19:14:46 [DEBUG   ] Got command BAM from MCS: ref #1231160
2019-01-20 19:14:46 [INFO    ] Finished processing BAM request
2019-01-20 19:14:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:14:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231160   8 58503 69286033 A  ERROR'
2019-01-20 19:14:46 [DEBUG   ] Got command BAM from MCS: ref #1231161
2019-01-20 19:14:46 [INFO    ] Finished processing BAM request
2019-01-20 19:14:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:14:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231161   8 58503 69286037 A  ERROR'
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:14:46 [DEBUG   ] spawn_process: at 2019-01-20 19:14:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:15:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:15:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:15:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:15:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:15:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:15:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:15:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:15:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:15:12 [DEBUG   ] Finished updating board flags in 1.167 seconds
2019-01-20 19:15:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 19:15:26 [DEBUG   ] Got command BAM from MCS: ref #1231163
2019-01-20 19:15:26 [INFO    ] Finished processing BAM request
2019-01-20 19:15:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231163   8 58503 69326025 A  ERROR'
2019-01-20 19:15:26 [DEBUG   ] Got command BAM from MCS: ref #1231162
2019-01-20 19:15:26 [INFO    ] Finished processing BAM request
2019-01-20 19:15:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231162   8 58503 69326029 A  ERROR'
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:15:26 [DEBUG   ] spawn_process: at 2019-01-20 19:15:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:15:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 19:16:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:16:06 [DEBUG   ] Got command BAM from MCS: ref #1231164
2019-01-20 19:16:06 [INFO    ] Finished processing BAM request
2019-01-20 19:16:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231164   8 58503 69366025 A  ERROR'
2019-01-20 19:16:06 [DEBUG   ] Got command BAM from MCS: ref #1231165
2019-01-20 19:16:06 [INFO    ] Finished processing BAM request
2019-01-20 19:16:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231165   8 58503 69366029 A  ERROR'
2019-01-20 19:16:06 [DEBUG   ] Got command RPT from MCS: ref #1231166
2019-01-20 19:16:06 [DEBUG   ] summary = ERROR
2019-01-20 19:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231166  13 58503 69366737 A  ERRORERROR'
2019-01-20 19:16:06 [DEBUG   ] Got command RPT from MCS: ref #1231167
2019-01-20 19:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231167  77 58503 69366738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:16:06 [DEBUG   ] spawn_process: at 2019-01-20 19:16:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:16:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 19:16:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:16:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:16:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:16:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:16:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:16:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:16:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:16:13 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-20 19:16:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:16:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 19:16:46 [DEBUG   ] Got command BAM from MCS: ref #1231187
2019-01-20 19:16:46 [INFO    ] Finished processing BAM request
2019-01-20 19:16:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:16:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231187   8 58503 69406033 A  ERROR'
2019-01-20 19:16:46 [DEBUG   ] Got command BAM from MCS: ref #1231188
2019-01-20 19:16:46 [INFO    ] Finished processing BAM request
2019-01-20 19:16:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:16:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231188   8 58503 69406037 A  ERROR'
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:16:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:16:46 [DEBUG   ] spawn_process: at 2019-01-20 19:16:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:17:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:17:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:17:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:17:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:17:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 19:17:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:17:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:17:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:17:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:17:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:17:12 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-20 19:17:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:17:26 [DEBUG   ] Got command BAM from MCS: ref #1231190
2019-01-20 19:17:26 [INFO    ] Finished processing BAM request
2019-01-20 19:17:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231190   8 58503 69446025 A  ERROR'
2019-01-20 19:17:26 [DEBUG   ] Got command BAM from MCS: ref #1231189
2019-01-20 19:17:26 [INFO    ] Finished processing BAM request
2019-01-20 19:17:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231189   8 58503 69446029 A  ERROR'
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 19:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 19:17:26 [DEBUG   ] spawn_process: at 2019-01-20 19:17:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 19:17:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:18:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:18:06 [DEBUG   ] Got command BAM from MCS: ref #1231191
2019-01-20 19:18:06 [INFO    ] Finished processing BAM request
2019-01-20 19:18:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:18:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231191   8 58503 69486029 A  ERROR'
2019-01-20 19:18:06 [DEBUG   ] Got command BAM from MCS: ref #1231192
2019-01-20 19:18:06 [INFO    ] Finished processing BAM request
2019-01-20 19:18:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:18:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231192   8 58503 69486033 A  ERROR'
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:18:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:18:06 [DEBUG   ] spawn_process: at 2019-01-20 19:18:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:18:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 19:18:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 19:18:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2019-01-20 19:18:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:18:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:18:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:18:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:18:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:18:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:18:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:18:12 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-20 19:18:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:18:26 [DEBUG   ] Got command RPT from MCS: ref #1231195
2019-01-20 19:18:26 [DEBUG   ] summary = ERROR
2019-01-20 19:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231195  13 58503 69506765 A  ERRORERROR'
2019-01-20 19:18:26 [DEBUG   ] Got command RPT from MCS: ref #1231196
2019-01-20 19:18:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231196  77 58503 69506969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:18:27 [DEBUG   ] Got command RPT from MCS: ref #1231197
2019-01-20 19:18:27 [DEBUG   ] summary = ERROR
2019-01-20 19:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231197  13 58503 69507161 A  ERRORERROR'
2019-01-20 19:18:27 [DEBUG   ] Got command RPT from MCS: ref #1231199
2019-01-20 19:18:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231199  77 58503 69507365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:18:27 [DEBUG   ] Got command RPT from MCS: ref #1231200
2019-01-20 19:18:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 19:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231200  12 58503 69507569 A  ERRORB¢ff'
2019-01-20 19:18:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:18:46 [DEBUG   ] Got command BAM from MCS: ref #1231205
2019-01-20 19:18:46 [INFO    ] Finished processing BAM request
2019-01-20 19:18:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:18:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231205   8 58503 69526033 A  ERROR'
2019-01-20 19:18:46 [DEBUG   ] Got command BAM from MCS: ref #1231206
2019-01-20 19:18:46 [INFO    ] Finished processing BAM request
2019-01-20 19:18:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:18:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231206   8 58503 69526037 A  ERROR'
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:18:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:18:46 [DEBUG   ] spawn_process: at 2019-01-20 19:18:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:19:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:19:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:19:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 19:19:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:19:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:19:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:19:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:19:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:19:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:19:12 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-01-20 19:19:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:19:26 [DEBUG   ] Got command BAM from MCS: ref #1231207
2019-01-20 19:19:26 [INFO    ] Finished processing BAM request
2019-01-20 19:19:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:19:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231207   8 58503 69566025 A  ERROR'
2019-01-20 19:19:26 [DEBUG   ] Got command BAM from MCS: ref #1231208
2019-01-20 19:19:26 [INFO    ] Finished processing BAM request
2019-01-20 19:19:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:19:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231208   8 58503 69566029 A  ERROR'
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 19:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 19:19:26 [DEBUG   ] spawn_process: at 2019-01-20 19:19:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 19:19:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:20:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:20:06 [DEBUG   ] Got command BAM from MCS: ref #1231213
2019-01-20 19:20:06 [INFO    ] Finished processing BAM request
2019-01-20 19:20:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:20:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231213   8 58503 69606029 A  ERROR'
2019-01-20 19:20:06 [DEBUG   ] Got command BAM from MCS: ref #1231214
2019-01-20 19:20:06 [INFO    ] Finished processing BAM request
2019-01-20 19:20:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:20:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231214   8 58503 69606033 A  ERROR'
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:20:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:20:06 [DEBUG   ] spawn_process: at 2019-01-20 19:20:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:20:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:20:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 19:20:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:20:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:20:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:20:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:20:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:20:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:20:12 [DEBUG   ] Finished updating board flags in 1.370 seconds
2019-01-20 19:20:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:20:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:20:46 [DEBUG   ] Got command BAM from MCS: ref #1231216
2019-01-20 19:20:46 [INFO    ] Finished processing BAM request
2019-01-20 19:20:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:20:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231216   8 58503 69646033 A  ERROR'
2019-01-20 19:20:46 [DEBUG   ] Got command BAM from MCS: ref #1231215
2019-01-20 19:20:46 [INFO    ] Finished processing BAM request
2019-01-20 19:20:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:20:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231215   8 58503 69646037 A  ERROR'
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:20:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:20:46 [DEBUG   ] spawn_process: at 2019-01-20 19:20:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:21:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:21:06 [DEBUG   ] Got command RPT from MCS: ref #1231217
2019-01-20 19:21:06 [DEBUG   ] summary = ERROR
2019-01-20 19:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231217  13 58503 69666729 A  ERRORERROR'
2019-01-20 19:21:06 [DEBUG   ] Got command RPT from MCS: ref #1231218
2019-01-20 19:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231218  77 58503 69666730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:21:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:21:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 19:21:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:21:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:21:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:21:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:21:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:21:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:21:13 [DEBUG   ] Finished updating board flags in 1.841 seconds
2019-01-20 19:21:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:21:26 [DEBUG   ] Got command BAM from MCS: ref #1231235
2019-01-20 19:21:26 [INFO    ] Finished processing BAM request
2019-01-20 19:21:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:21:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231235   8 58503 69686033 A  ERROR'
2019-01-20 19:21:26 [DEBUG   ] Got command BAM from MCS: ref #1231234
2019-01-20 19:21:26 [INFO    ] Finished processing BAM request
2019-01-20 19:21:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:21:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231234   8 58503 69686037 A  ERROR'
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:21:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:21:26 [DEBUG   ] spawn_process: at 2019-01-20 19:21:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:21:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:22:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:22:06 [DEBUG   ] Got command BAM from MCS: ref #1231237
2019-01-20 19:22:06 [INFO    ] Finished processing BAM request
2019-01-20 19:22:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:22:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231237   8 58503 69726029 A  ERROR'
2019-01-20 19:22:06 [DEBUG   ] Got command BAM from MCS: ref #1231236
2019-01-20 19:22:06 [INFO    ] Finished processing BAM request
2019-01-20 19:22:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:22:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231236   8 58503 69726033 A  ERROR'
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:22:06 [DEBUG   ] spawn_process: at 2019-01-20 19:22:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:22:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 19:22:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:22:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:22:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:22:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 19:22:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:22:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:22:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:22:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:22:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:22:12 [DEBUG   ] Finished updating board flags in 1.177 seconds
2019-01-20 19:22:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:22:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:22:46 [DEBUG   ] Got command BAM from MCS: ref #1231242
2019-01-20 19:22:46 [INFO    ] Finished processing BAM request
2019-01-20 19:22:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:22:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231242   8 58503 69766033 A  ERROR'
2019-01-20 19:22:46 [DEBUG   ] Got command BAM from MCS: ref #1231243
2019-01-20 19:22:46 [INFO    ] Finished processing BAM request
2019-01-20 19:22:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:22:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231243   8 58503 69766037 A  ERROR'
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 19:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 19:22:46 [DEBUG   ] spawn_process: at 2019-01-20 19:22:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 19:23:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:23:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:23:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 19:23:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:23:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:23:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:23:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:23:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:23:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:23:12 [DEBUG   ] Finished updating board flags in 1.003 seconds
2019-01-20 19:23:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:23:26 [DEBUG   ] Got command BAM from MCS: ref #1231245
2019-01-20 19:23:26 [INFO    ] Finished processing BAM request
2019-01-20 19:23:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231245   8 58503 69806033 A  ERROR'
2019-01-20 19:23:26 [DEBUG   ] Got command BAM from MCS: ref #1231244
2019-01-20 19:23:26 [INFO    ] Finished processing BAM request
2019-01-20 19:23:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231244   8 58503 69806037 A  ERROR'
2019-01-20 19:23:26 [DEBUG   ] Got command RPT from MCS: ref #1231246
2019-01-20 19:23:26 [DEBUG   ] summary = ERROR
2019-01-20 19:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231246  13 58503 69806853 A  ERRORERROR'
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:23:26 [DEBUG   ] spawn_process: at 2019-01-20 19:23:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:23:27 [DEBUG   ] Got command RPT from MCS: ref #1231247
2019-01-20 19:23:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231247  77 58503 69807045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:23:27 [DEBUG   ] Got command RPT from MCS: ref #1231248
2019-01-20 19:23:27 [DEBUG   ] summary = ERROR
2019-01-20 19:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231248  13 58503 69807253 A  ERRORERROR'
2019-01-20 19:23:27 [DEBUG   ] Got command RPT from MCS: ref #1231249
2019-01-20 19:23:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231249  77 58503 69807457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:23:27 [DEBUG   ] Got command RPT from MCS: ref #1231250
2019-01-20 19:23:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 19:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231250  12 58503 69807649 A  ERRORB¢ff'
2019-01-20 19:23:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:24:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:24:06 [DEBUG   ] Got command BAM from MCS: ref #1231252
2019-01-20 19:24:06 [INFO    ] Finished processing BAM request
2019-01-20 19:24:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231252   8 58503 69846033 A  ERROR'
2019-01-20 19:24:06 [DEBUG   ] Got command BAM from MCS: ref #1231251
2019-01-20 19:24:06 [INFO    ] Finished processing BAM request
2019-01-20 19:24:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231251   8 58503 69846037 A  ERROR'
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:24:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:24:06 [DEBUG   ] spawn_process: at 2019-01-20 19:24:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:24:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:24:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 19:24:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:24:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:24:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:24:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:24:12 [WARNING ] (13, 1, 'bot')
2019-01-20 19:24:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:24:12 [DEBUG   ] Finished updating board flags in 0.995 seconds
2019-01-20 19:24:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:24:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:24:46 [DEBUG   ] Got command BAM from MCS: ref #1231253
2019-01-20 19:24:46 [INFO    ] Finished processing BAM request
2019-01-20 19:24:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:24:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231253   8 58503 69886029 A  ERROR'
2019-01-20 19:24:46 [DEBUG   ] Got command BAM from MCS: ref #1231254
2019-01-20 19:24:46 [INFO    ] Finished processing BAM request
2019-01-20 19:24:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:24:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231254   8 58503 69886033 A  ERROR'
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:24:46 [DEBUG   ] spawn_process: at 2019-01-20 19:24:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:25:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:25:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:25:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:25:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 19:25:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:25:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:25:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:25:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:25:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:25:13 [DEBUG   ] Finished updating board flags in 1.367 seconds
2019-01-20 19:25:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:25:26 [DEBUG   ] Got command BAM from MCS: ref #1231256
2019-01-20 19:25:26 [INFO    ] Finished processing BAM request
2019-01-20 19:25:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231256   8 58503 69926025 A  ERROR'
2019-01-20 19:25:26 [DEBUG   ] Got command BAM from MCS: ref #1231255
2019-01-20 19:25:26 [INFO    ] Finished processing BAM request
2019-01-20 19:25:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231255   8 58503 69926029 A  ERROR'
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:25:26 [DEBUG   ] spawn_process: at 2019-01-20 19:25:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:25:43 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 19:26:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:26:06 [DEBUG   ] Got command BAM from MCS: ref #1231262
2019-01-20 19:26:06 [INFO    ] Finished processing BAM request
2019-01-20 19:26:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231262   8 58503 69966033 A  ERROR'
2019-01-20 19:26:06 [DEBUG   ] Got command BAM from MCS: ref #1231261
2019-01-20 19:26:06 [INFO    ] Finished processing BAM request
2019-01-20 19:26:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231261   8 58503 69966037 A  ERROR'
2019-01-20 19:26:06 [DEBUG   ] Got command RPT from MCS: ref #1231263
2019-01-20 19:26:06 [DEBUG   ] summary = ERROR
2019-01-20 19:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231263  13 58503 69966733 A  ERRORERROR'
2019-01-20 19:26:06 [DEBUG   ] Got command RPT from MCS: ref #1231264
2019-01-20 19:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231264  77 58503 69966734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:26:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:26:06 [DEBUG   ] spawn_process: at 2019-01-20 19:26:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:26:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 19:26:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:26:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:26:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:26:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:26:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:26:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:26:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:26:13 [DEBUG   ] Finished updating board flags in 1.209 seconds
2019-01-20 19:26:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:26:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:26:46 [DEBUG   ] Got command BAM from MCS: ref #1231280
2019-01-20 19:26:46 [INFO    ] Finished processing BAM request
2019-01-20 19:26:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:26:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231280   8 58503 70006029 A  ERROR'
2019-01-20 19:26:46 [DEBUG   ] Got command BAM from MCS: ref #1231281
2019-01-20 19:26:46 [INFO    ] Finished processing BAM request
2019-01-20 19:26:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:26:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231281   8 58503 70006033 A  ERROR'
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:26:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:26:46 [DEBUG   ] spawn_process: at 2019-01-20 19:26:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:27:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:27:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 19:27:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:27:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:27:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 19:27:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:27:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:27:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:27:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:27:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:27:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:27:13 [DEBUG   ] Finished updating board flags in 1.241 seconds
2019-01-20 19:27:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:27:26 [DEBUG   ] Got command BAM from MCS: ref #1231283
2019-01-20 19:27:26 [INFO    ] Finished processing BAM request
2019-01-20 19:27:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231283   8 58503 70046033 A  ERROR'
2019-01-20 19:27:26 [DEBUG   ] Got command BAM from MCS: ref #1231282
2019-01-20 19:27:26 [INFO    ] Finished processing BAM request
2019-01-20 19:27:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231282   8 58503 70046037 A  ERROR'
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:27:26 [DEBUG   ] spawn_process: at 2019-01-20 19:27:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:27:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:28:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:28:06 [DEBUG   ] Got command BAM from MCS: ref #1231285
2019-01-20 19:28:06 [INFO    ] Finished processing BAM request
2019-01-20 19:28:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:28:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231285   8 58503 70086033 A  ERROR'
2019-01-20 19:28:06 [DEBUG   ] Got command BAM from MCS: ref #1231284
2019-01-20 19:28:06 [INFO    ] Finished processing BAM request
2019-01-20 19:28:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:28:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231284   8 58503 70086037 A  ERROR'
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 19:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 19:28:06 [DEBUG   ] spawn_process: at 2019-01-20 19:28:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 19:28:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 19:28:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-20 19:28:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:28:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:28:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:28:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:28:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:28:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:28:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:28:13 [DEBUG   ] Finished updating board flags in 1.140 seconds
2019-01-20 19:28:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:28:26 [DEBUG   ] Got command RPT from MCS: ref #1231288
2019-01-20 19:28:26 [DEBUG   ] summary = ERROR
2019-01-20 19:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231288  13 58503 70106933 A  ERRORERROR'
2019-01-20 19:28:27 [DEBUG   ] Got command RPT from MCS: ref #1231289
2019-01-20 19:28:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231289  77 58503 70107137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:28:27 [DEBUG   ] Got command RPT from MCS: ref #1231290
2019-01-20 19:28:27 [DEBUG   ] summary = ERROR
2019-01-20 19:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231290  13 58503 70107341 A  ERRORERROR'
2019-01-20 19:28:27 [DEBUG   ] Got command RPT from MCS: ref #1231292
2019-01-20 19:28:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231292  77 58503 70107533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:28:27 [DEBUG   ] Got command RPT from MCS: ref #1231294
2019-01-20 19:28:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 19:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231294  12 58503 70107737 A  ERRORB¢ff'
2019-01-20 19:28:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:28:46 [DEBUG   ] Got command BAM from MCS: ref #1231303
2019-01-20 19:28:46 [INFO    ] Finished processing BAM request
2019-01-20 19:28:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:28:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231303   8 58503 70126025 A  ERROR'
2019-01-20 19:28:46 [DEBUG   ] Got command BAM from MCS: ref #1231302
2019-01-20 19:28:46 [INFO    ] Finished processing BAM request
2019-01-20 19:28:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:28:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231302   8 58503 70126029 A  ERROR'
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:28:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:28:46 [DEBUG   ] spawn_process: at 2019-01-20 19:28:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:29:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:29:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 19:29:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:29:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-20 19:29:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:29:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:29:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:29:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:29:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:29:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:29:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:29:13 [DEBUG   ] Finished updating board flags in 1.054 seconds
2019-01-20 19:29:23 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-20 19:29:26 [DEBUG   ] Got command BAM from MCS: ref #1231304
2019-01-20 19:29:26 [INFO    ] Finished processing BAM request
2019-01-20 19:29:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:29:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231304   8 58503 70166025 A  ERROR'
2019-01-20 19:29:26 [DEBUG   ] Got command BAM from MCS: ref #1231305
2019-01-20 19:29:26 [INFO    ] Finished processing BAM request
2019-01-20 19:29:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:29:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231305   8 58503 70166029 A  ERROR'
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:29:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:29:26 [DEBUG   ] spawn_process: at 2019-01-20 19:29:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:29:44 [DEBUG   ] Finished updating ant stats in 1.182 seconds
2019-01-20 19:30:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:30:06 [DEBUG   ] Got command BAM from MCS: ref #1231307
2019-01-20 19:30:06 [INFO    ] Finished processing BAM request
2019-01-20 19:30:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:30:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231307   8 58503 70206033 A  ERROR'
2019-01-20 19:30:06 [DEBUG   ] Got command BAM from MCS: ref #1231306
2019-01-20 19:30:06 [INFO    ] Finished processing BAM request
2019-01-20 19:30:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:30:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231306   8 58503 70206037 A  ERROR'
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:30:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:30:06 [DEBUG   ] spawn_process: at 2019-01-20 19:30:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:30:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 19:30:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:30:14 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:30:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:30:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:30:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:30:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:30:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:30:14 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-01-20 19:30:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:30:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:30:46 [DEBUG   ] Got command BAM from MCS: ref #1231309
2019-01-20 19:30:46 [INFO    ] Finished processing BAM request
2019-01-20 19:30:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:30:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231309   8 58503 70246033 A  ERROR'
2019-01-20 19:30:46 [DEBUG   ] Got command BAM from MCS: ref #1231308
2019-01-20 19:30:46 [INFO    ] Finished processing BAM request
2019-01-20 19:30:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:30:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231308   8 58503 70246037 A  ERROR'
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:30:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:30:46 [DEBUG   ] spawn_process: at 2019-01-20 19:30:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:31:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:31:06 [DEBUG   ] Got command RPT from MCS: ref #1231310
2019-01-20 19:31:06 [DEBUG   ] summary = ERROR
2019-01-20 19:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231310  13 58503 70266741 A  ERRORERROR'
2019-01-20 19:31:06 [DEBUG   ] Got command RPT from MCS: ref #1231311
2019-01-20 19:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231311  77 58503 70266742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:31:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 19:31:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:31:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:31:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:31:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:31:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:31:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:31:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:31:13 [DEBUG   ] Finished updating board flags in 1.221 seconds
2019-01-20 19:31:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:31:25 [DEBUG   ] Got command BAM from MCS: ref #1231327
2019-01-20 19:31:25 [INFO    ] Finished processing BAM request
2019-01-20 19:31:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:31:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231327   8 58503 70285025 A  ERROR'
2019-01-20 19:31:25 [DEBUG   ] Got command BAM from MCS: ref #1231328
2019-01-20 19:31:25 [INFO    ] Finished processing BAM request
2019-01-20 19:31:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:31:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231328   8 58503 70285029 A  ERROR'
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:31:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:31:25 [DEBUG   ] spawn_process: at 2019-01-20 19:31:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:31:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:32:04 [DEBUG   ] Got command BAM from MCS: ref #1231333
2019-01-20 19:32:04 [INFO    ] Finished processing BAM request
2019-01-20 19:32:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:32:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231333   8 58503 70324029 A  ERROR'
2019-01-20 19:32:04 [DEBUG   ] Got command BAM from MCS: ref #1231334
2019-01-20 19:32:04 [INFO    ] Finished processing BAM request
2019-01-20 19:32:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:32:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231334   8 58503 70324033 A  ERROR'
2019-01-20 19:32:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:32:04 [DEBUG   ] spawn_process: at 2019-01-20 19:32:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:32:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 19:32:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:32:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:32:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 19:32:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:32:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:32:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:32:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:32:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:32:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:32:13 [DEBUG   ] Finished updating board flags in 1.192 seconds
2019-01-20 19:32:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:32:43 [DEBUG   ] Got command BAM from MCS: ref #1231336
2019-01-20 19:32:43 [INFO    ] Finished processing BAM request
2019-01-20 19:32:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231336   8 58503 70363025 A  ERROR'
2019-01-20 19:32:43 [DEBUG   ] Got command BAM from MCS: ref #1231335
2019-01-20 19:32:43 [INFO    ] Finished processing BAM request
2019-01-20 19:32:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231335   8 58503 70363029 A  ERROR'
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:32:43 [DEBUG   ] spawn_process: at 2019-01-20 19:32:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:32:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:33:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:33:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 19:33:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:33:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:33:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 19:33:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:33:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:33:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:33:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:33:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:33:13 [DEBUG   ] Finished updating board flags in 1.025 seconds
2019-01-20 19:33:22 [DEBUG   ] Got command BAM from MCS: ref #1231338
2019-01-20 19:33:22 [INFO    ] Finished processing BAM request
2019-01-20 19:33:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231338   8 58503 70402033 A  ERROR'
2019-01-20 19:33:22 [DEBUG   ] Got command BAM from MCS: ref #1231337
2019-01-20 19:33:22 [INFO    ] Finished processing BAM request
2019-01-20 19:33:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231337   8 58503 70402037 A  ERROR'
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:33:22 [DEBUG   ] spawn_process: at 2019-01-20 19:33:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:33:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:33:27 [DEBUG   ] Got command RPT from MCS: ref #1231339
2019-01-20 19:33:27 [DEBUG   ] summary = ERROR
2019-01-20 19:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231339  13 58503 70407017 A  ERRORERROR'
2019-01-20 19:33:27 [DEBUG   ] Got command RPT from MCS: ref #1231340
2019-01-20 19:33:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231340  77 58503 70407221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:33:27 [DEBUG   ] Got command RPT from MCS: ref #1231341
2019-01-20 19:33:27 [DEBUG   ] summary = ERROR
2019-01-20 19:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231341  13 58503 70407425 A  ERRORERROR'
2019-01-20 19:33:27 [DEBUG   ] Got command RPT from MCS: ref #1231342
2019-01-20 19:33:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231342  77 58503 70407617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:33:27 [DEBUG   ] Got command RPT from MCS: ref #1231343
2019-01-20 19:33:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 19:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231343  12 58503 70407821 A  ERRORB¢ff'
2019-01-20 19:33:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:34:01 [DEBUG   ] Got command BAM from MCS: ref #1231344
2019-01-20 19:34:01 [INFO    ] Finished processing BAM request
2019-01-20 19:34:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231344   8 58503 70441029 A  ERROR'
2019-01-20 19:34:01 [DEBUG   ] Got command BAM from MCS: ref #1231345
2019-01-20 19:34:01 [INFO    ] Finished processing BAM request
2019-01-20 19:34:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231345   8 58503 70441033 A  ERROR'
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:34:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:34:01 [DEBUG   ] spawn_process: at 2019-01-20 19:34:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:34:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:34:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:34:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:34:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 19:34:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:34:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:34:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:34:13 [WARNING ] (13, 1, 'bot')
2019-01-20 19:34:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:34:13 [DEBUG   ] Finished updating board flags in 0.966 seconds
2019-01-20 19:34:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:34:40 [DEBUG   ] Got command BAM from MCS: ref #1231351
2019-01-20 19:34:40 [INFO    ] Finished processing BAM request
2019-01-20 19:34:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231351   8 58503 70480033 A  ERROR'
2019-01-20 19:34:40 [DEBUG   ] Got command BAM from MCS: ref #1231350
2019-01-20 19:34:40 [INFO    ] Finished processing BAM request
2019-01-20 19:34:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231350   8 58503 70480037 A  ERROR'
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:34:40 [DEBUG   ] spawn_process: at 2019-01-20 19:34:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:34:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:35:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:35:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 19:35:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:35:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:35:14 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:35:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:35:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:35:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:35:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:35:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:35:14 [DEBUG   ] Finished updating board flags in 1.368 seconds
2019-01-20 19:35:19 [DEBUG   ] Got command BAM from MCS: ref #1231352
2019-01-20 19:35:19 [INFO    ] Finished processing BAM request
2019-01-20 19:35:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231352   8 58503 70519025 A  ERROR'
2019-01-20 19:35:19 [DEBUG   ] Got command BAM from MCS: ref #1231353
2019-01-20 19:35:19 [INFO    ] Finished processing BAM request
2019-01-20 19:35:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231353   8 58503 70519029 A  ERROR'
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:35:19 [DEBUG   ] spawn_process: at 2019-01-20 19:35:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:35:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:35:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:35:58 [DEBUG   ] Got command BAM from MCS: ref #1231355
2019-01-20 19:35:58 [INFO    ] Finished processing BAM request
2019-01-20 19:35:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231355   8 58503 70558033 A  ERROR'
2019-01-20 19:35:58 [DEBUG   ] Got command BAM from MCS: ref #1231354
2019-01-20 19:35:58 [INFO    ] Finished processing BAM request
2019-01-20 19:35:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231354   8 58503 70558037 A  ERROR'
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 19:35:58 [DEBUG   ] spawn_process: at 2019-01-20 19:35:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 19:36:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:36:06 [DEBUG   ] Got command RPT from MCS: ref #1231356
2019-01-20 19:36:06 [DEBUG   ] summary = ERROR
2019-01-20 19:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231356  13 58503 70566737 A  ERRORERROR'
2019-01-20 19:36:06 [DEBUG   ] Got command RPT from MCS: ref #1231357
2019-01-20 19:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231357  77 58503 70566738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:36:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 19:36:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:36:14 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:36:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:36:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:36:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:36:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:36:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:36:14 [DEBUG   ] Finished updating board flags in 1.265 seconds
2019-01-20 19:36:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:36:37 [DEBUG   ] Got command BAM from MCS: ref #1231374
2019-01-20 19:36:37 [INFO    ] Finished processing BAM request
2019-01-20 19:36:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231374   8 58503 70597029 A  ERROR'
2019-01-20 19:36:37 [DEBUG   ] Got command BAM from MCS: ref #1231373
2019-01-20 19:36:37 [INFO    ] Finished processing BAM request
2019-01-20 19:36:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231373   8 58503 70597033 A  ERROR'
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:36:37 [DEBUG   ] spawn_process: at 2019-01-20 19:36:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:36:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:37:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:37:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:37:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:37:14 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:37:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 19:37:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:37:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:37:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:37:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:37:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:37:14 [DEBUG   ] Finished updating board flags in 1.216 seconds
2019-01-20 19:37:16 [DEBUG   ] Got command BAM from MCS: ref #1231375
2019-01-20 19:37:16 [INFO    ] Finished processing BAM request
2019-01-20 19:37:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:37:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231375   8 58503 70636025 A  ERROR'
2019-01-20 19:37:16 [DEBUG   ] Got command BAM from MCS: ref #1231376
2019-01-20 19:37:16 [INFO    ] Finished processing BAM request
2019-01-20 19:37:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:37:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231376   8 58503 70636029 A  ERROR'
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:37:16 [DEBUG   ] spawn_process: at 2019-01-20 19:37:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:37:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:37:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:37:55 [DEBUG   ] Got command BAM from MCS: ref #1231381
2019-01-20 19:37:55 [INFO    ] Finished processing BAM request
2019-01-20 19:37:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:37:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231381   8 58503 70675025 A  ERROR'
2019-01-20 19:37:55 [DEBUG   ] Got command BAM from MCS: ref #1231382
2019-01-20 19:37:55 [INFO    ] Finished processing BAM request
2019-01-20 19:37:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:37:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231382   8 58503 70675029 A  ERROR'
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:37:55 [DEBUG   ] spawn_process: at 2019-01-20 19:37:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:38:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:38:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 19:38:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 19:38:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:38:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:38:14 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:38:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:38:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:38:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:38:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:38:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:38:14 [DEBUG   ] Finished updating board flags in 1.112 seconds
2019-01-20 19:38:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:38:27 [DEBUG   ] Got command RPT from MCS: ref #1231385
2019-01-20 19:38:27 [DEBUG   ] summary = ERROR
2019-01-20 19:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231385  13 58503 70707109 A  ERRORERROR'
2019-01-20 19:38:27 [DEBUG   ] Got command RPT from MCS: ref #1231386
2019-01-20 19:38:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231386  77 58503 70707313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:38:27 [DEBUG   ] Got command RPT from MCS: ref #1231387
2019-01-20 19:38:27 [DEBUG   ] summary = ERROR
2019-01-20 19:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231387  13 58503 70707516 A  ERRORERROR'
2019-01-20 19:38:27 [DEBUG   ] Got command RPT from MCS: ref #1231389
2019-01-20 19:38:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231389  77 58503 70707705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:38:27 [DEBUG   ] Got command RPT from MCS: ref #1231390
2019-01-20 19:38:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 19:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231390  12 58503 70707917 A  ERRORB¡ff'
2019-01-20 19:38:34 [DEBUG   ] Got command BAM from MCS: ref #1231395
2019-01-20 19:38:34 [INFO    ] Finished processing BAM request
2019-01-20 19:38:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231395   8 58503 70714033 A  ERROR'
2019-01-20 19:38:34 [DEBUG   ] Got command BAM from MCS: ref #1231396
2019-01-20 19:38:34 [INFO    ] Finished processing BAM request
2019-01-20 19:38:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231396   8 58503 70714037 A  ERROR'
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:38:34 [DEBUG   ] spawn_process: at 2019-01-20 19:38:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:38:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:39:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:39:13 [DEBUG   ] Got command BAM from MCS: ref #1231397
2019-01-20 19:39:13 [INFO    ] Finished processing BAM request
2019-01-20 19:39:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231397   8 58503 70753025 A  ERROR'
2019-01-20 19:39:13 [DEBUG   ] Got command BAM from MCS: ref #1231398
2019-01-20 19:39:13 [INFO    ] Finished processing BAM request
2019-01-20 19:39:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231398   8 58503 70753029 A  ERROR'
2019-01-20 19:39:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 19:39:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:39:13 [DEBUG   ] spawn_process: at 2019-01-20 19:39:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:39:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:39:14 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:39:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:39:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:39:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:39:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:39:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:39:14 [DEBUG   ] Finished updating board flags in 1.022 seconds
2019-01-20 19:39:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:39:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:39:52 [DEBUG   ] Got command BAM from MCS: ref #1231400
2019-01-20 19:39:52 [INFO    ] Finished processing BAM request
2019-01-20 19:39:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231400   8 58503 70792033 A  ERROR'
2019-01-20 19:39:52 [DEBUG   ] Got command BAM from MCS: ref #1231399
2019-01-20 19:39:52 [INFO    ] Finished processing BAM request
2019-01-20 19:39:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231399   8 58503 70792037 A  ERROR'
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:39:52 [DEBUG   ] spawn_process: at 2019-01-20 19:39:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:40:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:40:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:40:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-20 19:40:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:40:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:40:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:40:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:40:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:40:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:40:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:40:14 [DEBUG   ] Finished updating board flags in 0.996 seconds
2019-01-20 19:40:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:40:31 [DEBUG   ] Got command BAM from MCS: ref #1231401
2019-01-20 19:40:31 [INFO    ] Finished processing BAM request
2019-01-20 19:40:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:40:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231401   8 58503 70831029 A  ERROR'
2019-01-20 19:40:31 [DEBUG   ] Got command BAM from MCS: ref #1231402
2019-01-20 19:40:31 [INFO    ] Finished processing BAM request
2019-01-20 19:40:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:40:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231402   8 58503 70831033 A  ERROR'
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:40:31 [DEBUG   ] spawn_process: at 2019-01-20 19:40:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:40:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:41:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:41:06 [DEBUG   ] Got command RPT from MCS: ref #1231407
2019-01-20 19:41:06 [DEBUG   ] summary = ERROR
2019-01-20 19:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231407  13 58503 70866733 A  ERRORERROR'
2019-01-20 19:41:06 [DEBUG   ] Got command RPT from MCS: ref #1231408
2019-01-20 19:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231408  77 58503 70866734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:41:10 [DEBUG   ] Got command BAM from MCS: ref #1231424
2019-01-20 19:41:10 [INFO    ] Finished processing BAM request
2019-01-20 19:41:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:41:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231424   8 58503 70870025 A  ERROR'
2019-01-20 19:41:10 [DEBUG   ] Got command BAM from MCS: ref #1231425
2019-01-20 19:41:10 [INFO    ] Finished processing BAM request
2019-01-20 19:41:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:41:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231425   8 58503 70870029 A  ERROR'
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:41:10 [DEBUG   ] spawn_process: at 2019-01-20 19:41:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:41:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:41:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-20 19:41:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:41:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:41:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:41:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:41:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:41:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:41:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:41:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:41:15 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-01-20 19:41:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:41:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:41:49 [DEBUG   ] Got command BAM from MCS: ref #1231426
2019-01-20 19:41:49 [INFO    ] Finished processing BAM request
2019-01-20 19:41:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231426   8 58503 70909033 A  ERROR'
2019-01-20 19:41:49 [DEBUG   ] Got command BAM from MCS: ref #1231427
2019-01-20 19:41:49 [INFO    ] Finished processing BAM request
2019-01-20 19:41:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231427   8 58503 70909037 A  ERROR'
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:41:49 [DEBUG   ] spawn_process: at 2019-01-20 19:41:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:42:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:42:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 19:42:14 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:42:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:42:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:42:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:42:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 19:42:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:42:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:42:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:42:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:42:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:42:14 [DEBUG   ] Finished updating board flags in 1.106 seconds
2019-01-20 19:42:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 19:42:28 [DEBUG   ] Got command BAM from MCS: ref #1231428
2019-01-20 19:42:28 [INFO    ] Finished processing BAM request
2019-01-20 19:42:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231428   8 58503 70948025 A  ERROR'
2019-01-20 19:42:28 [DEBUG   ] Got command BAM from MCS: ref #1231429
2019-01-20 19:42:28 [INFO    ] Finished processing BAM request
2019-01-20 19:42:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231429   8 58503 70948029 A  ERROR'
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:42:28 [DEBUG   ] spawn_process: at 2019-01-20 19:42:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:42:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:43:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:43:07 [DEBUG   ] Got command BAM from MCS: ref #1231431
2019-01-20 19:43:07 [INFO    ] Finished processing BAM request
2019-01-20 19:43:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:43:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231431   8 58503 70987025 A  ERROR'
2019-01-20 19:43:07 [DEBUG   ] Got command BAM from MCS: ref #1231430
2019-01-20 19:43:07 [INFO    ] Finished processing BAM request
2019-01-20 19:43:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:43:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231430   8 58503 70987029 A  ERROR'
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:43:07 [DEBUG   ] spawn_process: at 2019-01-20 19:43:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:43:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2019-01-20 19:43:14 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 19:43:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:43:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-20 19:43:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:43:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:43:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:43:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 19:43:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:43:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:43:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:43:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:43:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:43:14 [DEBUG   ] Finished updating board flags in 1.018 seconds
2019-01-20 19:43:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 19:43:27 [DEBUG   ] Got command RPT from MCS: ref #1231432
2019-01-20 19:43:27 [DEBUG   ] summary = ERROR
2019-01-20 19:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231432  13 58503 71007197 A  ERRORERROR'
2019-01-20 19:43:27 [DEBUG   ] Got command RPT from MCS: ref #1231433
2019-01-20 19:43:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231433  77 58503 71007389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:43:27 [DEBUG   ] Got command RPT from MCS: ref #1231434
2019-01-20 19:43:27 [DEBUG   ] summary = ERROR
2019-01-20 19:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231434  13 58503 71007593 A  ERRORERROR'
2019-01-20 19:43:27 [DEBUG   ] Got command RPT from MCS: ref #1231435
2019-01-20 19:43:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231435  77 58503 71007797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:43:28 [DEBUG   ] Got command RPT from MCS: ref #1231436
2019-01-20 19:43:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 19:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231436  12 58503 71008001 A  ERRORB¤ff'
2019-01-20 19:43:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 19:43:46 [DEBUG   ] Got command BAM from MCS: ref #1231442
2019-01-20 19:43:46 [INFO    ] Finished processing BAM request
2019-01-20 19:43:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:43:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231442   8 58503 71026029 A  ERROR'
2019-01-20 19:43:46 [DEBUG   ] Got command BAM from MCS: ref #1231441
2019-01-20 19:43:46 [INFO    ] Finished processing BAM request
2019-01-20 19:43:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:43:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231441   8 58503 71026033 A  ERROR'
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 19:43:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 19:43:46 [DEBUG   ] spawn_process: at 2019-01-20 19:43:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 19:44:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 19:44:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 19:44:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:44:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:44:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 19:44:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:44:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:44:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:44:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:44:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:44:14 [WARNING ] (13, 1, 'bot')
2019-01-20 19:44:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:44:14 [DEBUG   ] Finished updating board flags in 0.920 seconds
2019-01-20 19:44:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 19:44:25 [DEBUG   ] Got command BAM from MCS: ref #1231443
2019-01-20 19:44:25 [INFO    ] Finished processing BAM request
2019-01-20 19:44:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:44:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231443   8 58503 71065029 A  ERROR'
2019-01-20 19:44:25 [DEBUG   ] Got command BAM from MCS: ref #1231444
2019-01-20 19:44:25 [INFO    ] Finished processing BAM request
2019-01-20 19:44:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:44:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231444   8 58503 71065033 A  ERROR'
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:44:25 [DEBUG   ] spawn_process: at 2019-01-20 19:44:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:44:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:45:04 [DEBUG   ] Got command BAM from MCS: ref #1231445
2019-01-20 19:45:04 [INFO    ] Finished processing BAM request
2019-01-20 19:45:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231445   8 58503 71104025 A  ERROR'
2019-01-20 19:45:04 [DEBUG   ] Got command BAM from MCS: ref #1231446
2019-01-20 19:45:04 [INFO    ] Finished processing BAM request
2019-01-20 19:45:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231446   8 58503 71104029 A  ERROR'
2019-01-20 19:45:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:45:04 [DEBUG   ] spawn_process: at 2019-01-20 19:45:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:45:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 19:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:45:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:45:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:45:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:45:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:45:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:45:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:45:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:45:15 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-20 19:45:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:45:43 [DEBUG   ] Got command BAM from MCS: ref #1231447
2019-01-20 19:45:43 [INFO    ] Finished processing BAM request
2019-01-20 19:45:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:45:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231447   8 58503 71143033 A  ERROR'
2019-01-20 19:45:43 [DEBUG   ] Got command BAM from MCS: ref #1231448
2019-01-20 19:45:43 [INFO    ] Finished processing BAM request
2019-01-20 19:45:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:45:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231448   8 58503 71143037 A  ERROR'
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:45:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:45:43 [DEBUG   ] spawn_process: at 2019-01-20 19:45:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:45:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:46:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:46:06 [DEBUG   ] Got command RPT from MCS: ref #1231449
2019-01-20 19:46:06 [DEBUG   ] summary = ERROR
2019-01-20 19:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231449  13 58503 71166741 A  ERRORERROR'
2019-01-20 19:46:06 [DEBUG   ] Got command RPT from MCS: ref #1231450
2019-01-20 19:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231450  77 58503 71166742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:46:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 19:46:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:46:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 19:46:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 19:46:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:46:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:46:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:46:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:46:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:46:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:46:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:46:15 [DEBUG   ] Finished updating board flags in 1.165 seconds
2019-01-20 19:46:22 [DEBUG   ] Got command BAM from MCS: ref #1231466
2019-01-20 19:46:22 [INFO    ] Finished processing BAM request
2019-01-20 19:46:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:46:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231466   8 58503 71182025 A  ERROR'
2019-01-20 19:46:22 [DEBUG   ] Got command BAM from MCS: ref #1231467
2019-01-20 19:46:22 [INFO    ] Finished processing BAM request
2019-01-20 19:46:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:46:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231467   8 58503 71182029 A  ERROR'
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:46:22 [DEBUG   ] spawn_process: at 2019-01-20 19:46:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:46:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:46:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:47:01 [DEBUG   ] Got command BAM from MCS: ref #1231473
2019-01-20 19:47:01 [INFO    ] Finished processing BAM request
2019-01-20 19:47:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231473   8 58503 71221033 A  ERROR'
2019-01-20 19:47:01 [DEBUG   ] Got command BAM from MCS: ref #1231472
2019-01-20 19:47:01 [INFO    ] Finished processing BAM request
2019-01-20 19:47:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231472   8 58503 71221037 A  ERROR'
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:47:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:47:01 [DEBUG   ] spawn_process: at 2019-01-20 19:47:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:47:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:47:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:47:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:47:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 19:47:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:47:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:47:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 19:47:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:47:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:47:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:47:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:47:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:47:15 [DEBUG   ] Finished updating board flags in 1.009 seconds
2019-01-20 19:47:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:47:40 [DEBUG   ] Got command BAM from MCS: ref #1231474
2019-01-20 19:47:40 [INFO    ] Finished processing BAM request
2019-01-20 19:47:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231474   8 58503 71260025 A  ERROR'
2019-01-20 19:47:40 [DEBUG   ] Got command BAM from MCS: ref #1231475
2019-01-20 19:47:40 [INFO    ] Finished processing BAM request
2019-01-20 19:47:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231475   8 58503 71260029 A  ERROR'
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:47:40 [DEBUG   ] spawn_process: at 2019-01-20 19:47:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:47:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:48:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:48:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:48:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:48:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 19:48:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:48:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 19:48:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:48:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:48:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:48:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:48:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:48:15 [DEBUG   ] Finished updating board flags in 1.001 seconds
2019-01-20 19:48:19 [DEBUG   ] Got command BAM from MCS: ref #1231479
2019-01-20 19:48:19 [INFO    ] Finished processing BAM request
2019-01-20 19:48:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231479   8 58503 71299033 A  ERROR'
2019-01-20 19:48:19 [DEBUG   ] Got command BAM from MCS: ref #1231478
2019-01-20 19:48:19 [INFO    ] Finished processing BAM request
2019-01-20 19:48:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231478   8 58503 71299037 A  ERROR'
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:48:19 [DEBUG   ] spawn_process: at 2019-01-20 19:48:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:48:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:48:27 [DEBUG   ] Got command RPT from MCS: ref #1231480
2019-01-20 19:48:27 [DEBUG   ] summary = ERROR
2019-01-20 19:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231480  13 58503 71307277 A  ERRORERROR'
2019-01-20 19:48:27 [DEBUG   ] Got command RPT from MCS: ref #1231481
2019-01-20 19:48:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231481  77 58503 71307481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:48:27 [DEBUG   ] Got command RPT from MCS: ref #1231482
2019-01-20 19:48:27 [DEBUG   ] summary = ERROR
2019-01-20 19:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231482  13 58503 71307685 A  ERRORERROR'
2019-01-20 19:48:27 [DEBUG   ] Got command RPT from MCS: ref #1231484
2019-01-20 19:48:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231484  77 58503 71307877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:48:28 [DEBUG   ] Got command RPT from MCS: ref #1231486
2019-01-20 19:48:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 19:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231486  12 58503 71308081 A  ERRORB¤ff'
2019-01-20 19:48:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 19:48:58 [DEBUG   ] Got command BAM from MCS: ref #1231490
2019-01-20 19:48:58 [INFO    ] Finished processing BAM request
2019-01-20 19:48:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:48:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231490   8 58503 71338033 A  ERROR'
2019-01-20 19:48:58 [DEBUG   ] Got command BAM from MCS: ref #1231491
2019-01-20 19:48:58 [INFO    ] Finished processing BAM request
2019-01-20 19:48:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:48:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231491   8 58503 71338037 A  ERROR'
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:48:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:48:58 [DEBUG   ] spawn_process: at 2019-01-20 19:48:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:49:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 19:49:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 19:49:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 19:49:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-20 19:49:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:49:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:49:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:49:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:49:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:49:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:49:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:49:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:49:15 [DEBUG   ] Finished updating board flags in 1.049 seconds
2019-01-20 19:49:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 19:49:37 [DEBUG   ] Got command BAM from MCS: ref #1231493
2019-01-20 19:49:37 [INFO    ] Finished processing BAM request
2019-01-20 19:49:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:49:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231493   8 58503 71377029 A  ERROR'
2019-01-20 19:49:37 [DEBUG   ] Got command BAM from MCS: ref #1231492
2019-01-20 19:49:37 [INFO    ] Finished processing BAM request
2019-01-20 19:49:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:49:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231492   8 58503 71377033 A  ERROR'
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:49:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:49:37 [DEBUG   ] spawn_process: at 2019-01-20 19:49:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:49:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:50:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:50:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 19:50:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 19:50:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:50:16 [DEBUG   ] Got command BAM from MCS: ref #1231499
2019-01-20 19:50:16 [INFO    ] Finished processing BAM request
2019-01-20 19:50:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:50:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231499   8 58503 71416029 A  ERROR'
2019-01-20 19:50:16 [DEBUG   ] Got command BAM from MCS: ref #1231498
2019-01-20 19:50:16 [INFO    ] Finished processing BAM request
2019-01-20 19:50:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:50:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231498   8 58503 71416037 A  ERROR'
2019-01-20 19:50:16 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:50:16 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:50:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 19:50:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:50:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:50:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:50:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:50:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:50:16 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:50:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:50:16 [DEBUG   ] spawn_process: at 2019-01-20 19:50:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:50:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:50:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:50:55 [DEBUG   ] Got command BAM from MCS: ref #1231500
2019-01-20 19:50:55 [INFO    ] Finished processing BAM request
2019-01-20 19:50:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:50:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231500   8 58503 71455029 A  ERROR'
2019-01-20 19:50:55 [DEBUG   ] Got command BAM from MCS: ref #1231501
2019-01-20 19:50:55 [INFO    ] Finished processing BAM request
2019-01-20 19:50:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:50:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231501   8 58503 71455033 A  ERROR'
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 19:50:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 19:50:55 [DEBUG   ] spawn_process: at 2019-01-20 19:50:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 19:51:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:51:06 [DEBUG   ] Got command RPT from MCS: ref #1231502
2019-01-20 19:51:06 [DEBUG   ] summary = ERROR
2019-01-20 19:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231502  13 58503 71466741 A  ERRORERROR'
2019-01-20 19:51:06 [DEBUG   ] Got command RPT from MCS: ref #1231503
2019-01-20 19:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231503  77 58503 71466742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:51:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 19:51:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 19:51:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 19:51:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:51:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:51:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:51:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 19:51:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:51:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:51:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:51:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:51:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:51:15 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-01-20 19:51:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:51:34 [DEBUG   ] Got command BAM from MCS: ref #1231519
2019-01-20 19:51:34 [INFO    ] Finished processing BAM request
2019-01-20 19:51:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231519   8 58503 71494029 A  ERROR'
2019-01-20 19:51:34 [DEBUG   ] Got command BAM from MCS: ref #1231520
2019-01-20 19:51:34 [INFO    ] Finished processing BAM request
2019-01-20 19:51:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231520   8 58503 71494033 A  ERROR'
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 19:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 19:51:34 [DEBUG   ] spawn_process: at 2019-01-20 19:51:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 19:51:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 19:52:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 19:52:13 [DEBUG   ] Got command BAM from MCS: ref #1231522
2019-01-20 19:52:13 [INFO    ] Finished processing BAM request
2019-01-20 19:52:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:52:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231522   8 58503 71533025 A  ERROR'
2019-01-20 19:52:13 [DEBUG   ] Got command BAM from MCS: ref #1231521
2019-01-20 19:52:13 [INFO    ] Finished processing BAM request
2019-01-20 19:52:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:52:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231521   8 58503 71533029 A  ERROR'
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 19:52:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 19:52:13 [DEBUG   ] spawn_process: at 2019-01-20 19:52:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 19:52:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 19:52:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:52:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-20 19:52:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:52:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:52:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:52:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:52:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:52:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:52:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:52:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:52:15 [DEBUG   ] Finished updating board flags in 1.219 seconds
2019-01-20 19:52:24 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-20 19:52:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 19:52:52 [DEBUG   ] Got command BAM from MCS: ref #1231527
2019-01-20 19:52:52 [INFO    ] Finished processing BAM request
2019-01-20 19:52:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:52:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231527   8 58503 71572029 A  ERROR'
2019-01-20 19:52:52 [DEBUG   ] Got command BAM from MCS: ref #1231528
2019-01-20 19:52:52 [INFO    ] Finished processing BAM request
2019-01-20 19:52:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:52:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231528   8 58503 71572033 A  ERROR'
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:52:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:52:52 [DEBUG   ] spawn_process: at 2019-01-20 19:52:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:53:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 19:53:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 19:53:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:53:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-20 19:53:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:53:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:53:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 19:53:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:53:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:53:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:53:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:53:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:53:15 [DEBUG   ] Finished updating board flags in 1.214 seconds
2019-01-20 19:53:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 19:53:27 [DEBUG   ] Got command RPT from MCS: ref #1231529
2019-01-20 19:53:27 [DEBUG   ] summary = ERROR
2019-01-20 19:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231529  13 58503 71607369 A  ERRORERROR'
2019-01-20 19:53:27 [DEBUG   ] Got command RPT from MCS: ref #1231530
2019-01-20 19:53:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231530  77 58503 71607561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:53:27 [DEBUG   ] Got command RPT from MCS: ref #1231531
2019-01-20 19:53:27 [DEBUG   ] summary = ERROR
2019-01-20 19:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231531  13 58503 71607765 A  ERRORERROR'
2019-01-20 19:53:27 [DEBUG   ] Got command RPT from MCS: ref #1231532
2019-01-20 19:53:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231532  77 58503 71607969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:53:28 [DEBUG   ] Got command RPT from MCS: ref #1231533
2019-01-20 19:53:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 19:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231533  12 58503 71608173 A  ERRORB¤ff'
2019-01-20 19:53:31 [DEBUG   ] Got command BAM from MCS: ref #1231534
2019-01-20 19:53:31 [INFO    ] Finished processing BAM request
2019-01-20 19:53:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231534   8 58503 71611033 A  ERROR'
2019-01-20 19:53:31 [DEBUG   ] Got command BAM from MCS: ref #1231535
2019-01-20 19:53:31 [INFO    ] Finished processing BAM request
2019-01-20 19:53:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231535   8 58503 71611037 A  ERROR'
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:53:31 [DEBUG   ] spawn_process: at 2019-01-20 19:53:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:53:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 19:54:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 19:54:10 [DEBUG   ] Got command BAM from MCS: ref #1231537
2019-01-20 19:54:10 [INFO    ] Finished processing BAM request
2019-01-20 19:54:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231537   8 58503 71650033 A  ERROR'
2019-01-20 19:54:10 [DEBUG   ] Got command BAM from MCS: ref #1231536
2019-01-20 19:54:10 [INFO    ] Finished processing BAM request
2019-01-20 19:54:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231536   8 58503 71650037 A  ERROR'
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:54:10 [DEBUG   ] spawn_process: at 2019-01-20 19:54:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:54:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 19:54:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:54:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:54:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:54:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:54:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 19:54:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:54:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:54:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:54:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:54:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:54:15 [DEBUG   ] Finished updating board flags in 1.177 seconds
2019-01-20 19:54:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 19:54:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:54:49 [DEBUG   ] Got command BAM from MCS: ref #1231538
2019-01-20 19:54:49 [INFO    ] Finished processing BAM request
2019-01-20 19:54:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:54:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231538   8 58503 71689033 A  ERROR'
2019-01-20 19:54:49 [DEBUG   ] Got command BAM from MCS: ref #1231539
2019-01-20 19:54:49 [INFO    ] Finished processing BAM request
2019-01-20 19:54:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:54:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231539   8 58503 71689037 A  ERROR'
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:54:49 [DEBUG   ] spawn_process: at 2019-01-20 19:54:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:55:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:55:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 19:55:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:55:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:55:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 19:55:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:55:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:55:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:55:15 [WARNING ] (13, 1, 'bot')
2019-01-20 19:55:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:55:15 [DEBUG   ] Finished updating board flags in 1.052 seconds
2019-01-20 19:55:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:55:28 [DEBUG   ] Got command BAM from MCS: ref #1231541
2019-01-20 19:55:28 [INFO    ] Finished processing BAM request
2019-01-20 19:55:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:55:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231541   8 58503 71728034 A  ERROR'
2019-01-20 19:55:28 [DEBUG   ] Got command BAM from MCS: ref #1231540
2019-01-20 19:55:28 [INFO    ] Finished processing BAM request
2019-01-20 19:55:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:55:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231540   8 58503 71728038 A  ERROR'
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:55:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:55:28 [DEBUG   ] spawn_process: at 2019-01-20 19:55:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:55:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:56:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:56:06 [DEBUG   ] Got command RPT from MCS: ref #1231548
2019-01-20 19:56:06 [DEBUG   ] summary = ERROR
2019-01-20 19:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231548  13 58503 71766738 A  ERRORERROR'
2019-01-20 19:56:06 [DEBUG   ] Got command RPT from MCS: ref #1231549
2019-01-20 19:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231549  77 58503 71766738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:56:07 [DEBUG   ] Got command BAM from MCS: ref #1231547
2019-01-20 19:56:07 [INFO    ] Finished processing BAM request
2019-01-20 19:56:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:56:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231547   8 58503 71767030 A  ERROR'
2019-01-20 19:56:07 [DEBUG   ] Got command BAM from MCS: ref #1231546
2019-01-20 19:56:07 [INFO    ] Finished processing BAM request
2019-01-20 19:56:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:56:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231546   8 58503 71767034 A  ERROR'
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:56:07 [DEBUG   ] spawn_process: at 2019-01-20 19:56:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:56:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:56:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:56:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:56:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 19:56:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:56:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:56:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:56:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:56:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:56:16 [DEBUG   ] Finished updating board flags in 1.539 seconds
2019-01-20 19:56:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:56:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:56:46 [DEBUG   ] Got command BAM from MCS: ref #1231565
2019-01-20 19:56:46 [INFO    ] Finished processing BAM request
2019-01-20 19:56:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231565   8 58503 71806033 A  ERROR'
2019-01-20 19:56:46 [DEBUG   ] Got command BAM from MCS: ref #1231566
2019-01-20 19:56:46 [INFO    ] Finished processing BAM request
2019-01-20 19:56:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231566   8 58503 71806037 A  ERROR'
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 19:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 19:56:46 [DEBUG   ] spawn_process: at 2019-01-20 19:56:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 19:57:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:57:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 19:57:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 19:57:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:57:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 19:57:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-01-20 19:57:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:57:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:57:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:57:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:57:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:57:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:57:16 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-20 19:57:25 [DEBUG   ] Got command BAM from MCS: ref #1231567
2019-01-20 19:57:25 [INFO    ] Finished processing BAM request
2019-01-20 19:57:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:57:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231567   8 58503 71845033 A  ERROR'
2019-01-20 19:57:25 [DEBUG   ] Got command BAM from MCS: ref #1231568
2019-01-20 19:57:25 [INFO    ] Finished processing BAM request
2019-01-20 19:57:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:57:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231568   8 58503 71845037 A  ERROR'
2019-01-20 19:57:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:57:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:57:25 [DEBUG   ] spawn_process: at 2019-01-20 19:57:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:57:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:58:04 [DEBUG   ] Got command BAM from MCS: ref #1231569
2019-01-20 19:58:04 [INFO    ] Finished processing BAM request
2019-01-20 19:58:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:58:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231569   8 58503 71884025 A  ERROR'
2019-01-20 19:58:04 [DEBUG   ] Got command BAM from MCS: ref #1231570
2019-01-20 19:58:04 [INFO    ] Finished processing BAM request
2019-01-20 19:58:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:58:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231570   8 58503 71884029 A  ERROR'
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:58:04 [DEBUG   ] spawn_process: at 2019-01-20 19:58:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:58:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:58:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 19:58:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 19:58:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:58:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-20 19:58:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:58:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 19:58:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 19:58:16 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-20 19:58:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:58:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:58:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:58:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:58:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:58:16 [DEBUG   ] Finished updating board flags in 1.353 seconds
2019-01-20 19:58:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:58:27 [DEBUG   ] Got command RPT from MCS: ref #1231573
2019-01-20 19:58:27 [DEBUG   ] summary = ERROR
2019-01-20 19:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231573  13 58503 71907445 A  ERRORERROR'
2019-01-20 19:58:27 [DEBUG   ] Got command RPT from MCS: ref #1231574
2019-01-20 19:58:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231574  77 58503 71907649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:58:27 [DEBUG   ] Got command RPT from MCS: ref #1231575
2019-01-20 19:58:27 [DEBUG   ] summary = ERROR
2019-01-20 19:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231575  13 58503 71907853 A  ERRORERROR'
2019-01-20 19:58:28 [DEBUG   ] Got command RPT from MCS: ref #1231577
2019-01-20 19:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 19:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231577  77 58503 71908045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 19:58:28 [DEBUG   ] Got command RPT from MCS: ref #1231578
2019-01-20 19:58:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 19:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231578  12 58503 71908249 A  ERRORB£ff'
2019-01-20 19:58:43 [DEBUG   ] Got command BAM from MCS: ref #1231587
2019-01-20 19:58:43 [INFO    ] Finished processing BAM request
2019-01-20 19:58:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231587   8 58503 71923025 A  ERROR'
2019-01-20 19:58:43 [DEBUG   ] Got command BAM from MCS: ref #1231588
2019-01-20 19:58:43 [INFO    ] Finished processing BAM request
2019-01-20 19:58:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231588   8 58503 71923029 A  ERROR'
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 19:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 19:58:43 [DEBUG   ] spawn_process: at 2019-01-20 19:58:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 19:58:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 19:59:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 19:59:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 19:59:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 19:59:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 19:59:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 19:59:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 19:59:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:59:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:59:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:59:16 [WARNING ] (13, 1, 'bot')
2019-01-20 19:59:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 19:59:16 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-01-20 19:59:22 [DEBUG   ] Got command BAM from MCS: ref #1231589
2019-01-20 19:59:22 [INFO    ] Finished processing BAM request
2019-01-20 19:59:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231589   8 58503 71962033 A  ERROR'
2019-01-20 19:59:22 [DEBUG   ] Got command BAM from MCS: ref #1231590
2019-01-20 19:59:22 [INFO    ] Finished processing BAM request
2019-01-20 19:59:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 19:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231590   8 58503 71962037 A  ERROR'
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 19:59:22 [DEBUG   ] spawn_process: at 2019-01-20 19:59:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 19:59:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 19:59:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:00:01 [DEBUG   ] Got command BAM from MCS: ref #1231592
2019-01-20 20:00:01 [INFO    ] Finished processing BAM request
2019-01-20 20:00:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231592   8 58503 72001029 A  ERROR'
2019-01-20 20:00:01 [DEBUG   ] Got command BAM from MCS: ref #1231591
2019-01-20 20:00:01 [INFO    ] Finished processing BAM request
2019-01-20 20:00:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231591   8 58503 72001033 A  ERROR'
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:00:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:00:01 [DEBUG   ] spawn_process: at 2019-01-20 20:00:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:00:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 20:00:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 20:00:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:00:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:00:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:00:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:00:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:00:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:00:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:00:16 [DEBUG   ] Finished updating board flags in 1.018 seconds
2019-01-20 20:00:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 20:00:40 [DEBUG   ] Got command BAM from MCS: ref #1231593
2019-01-20 20:00:40 [INFO    ] Finished processing BAM request
2019-01-20 20:00:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231593   8 58503 72040033 A  ERROR'
2019-01-20 20:00:40 [DEBUG   ] Got command BAM from MCS: ref #1231594
2019-01-20 20:00:40 [INFO    ] Finished processing BAM request
2019-01-20 20:00:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:00:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231594   8 58503 72040037 A  ERROR'
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:00:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:00:40 [DEBUG   ] spawn_process: at 2019-01-20 20:00:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:00:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 20:01:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 20:01:06 [DEBUG   ] Got command RPT from MCS: ref #1231595
2019-01-20 20:01:06 [DEBUG   ] summary = ERROR
2019-01-20 20:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231595  13 58503 72066749 A  ERRORERROR'
2019-01-20 20:01:06 [DEBUG   ] Got command RPT from MCS: ref #1231596
2019-01-20 20:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231596  77 58503 72066750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:01:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:01:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:01:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:01:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:01:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:01:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:01:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:01:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:01:16 [DEBUG   ] Finished updating board flags in 1.018 seconds
2019-01-20 20:01:19 [DEBUG   ] Got command BAM from MCS: ref #1231613
2019-01-20 20:01:19 [INFO    ] Finished processing BAM request
2019-01-20 20:01:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:01:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231613   8 58503 72079029 A  ERROR'
2019-01-20 20:01:19 [DEBUG   ] Got command BAM from MCS: ref #1231612
2019-01-20 20:01:19 [INFO    ] Finished processing BAM request
2019-01-20 20:01:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:01:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231612   8 58503 72079033 A  ERROR'
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:01:19 [DEBUG   ] spawn_process: at 2019-01-20 20:01:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:01:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 20:01:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 20:01:58 [DEBUG   ] Got command BAM from MCS: ref #1231619
2019-01-20 20:01:58 [INFO    ] Finished processing BAM request
2019-01-20 20:01:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:01:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231619   8 58503 72118033 A  ERROR'
2019-01-20 20:01:58 [DEBUG   ] Got command BAM from MCS: ref #1231618
2019-01-20 20:01:58 [INFO    ] Finished processing BAM request
2019-01-20 20:01:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:01:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231618   8 58503 72118037 A  ERROR'
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:01:58 [DEBUG   ] spawn_process: at 2019-01-20 20:01:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:02:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:02:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:02:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:02:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 20:02:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 20:02:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:02:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:02:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:02:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:02:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:02:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:02:16 [DEBUG   ] Finished updating board flags in 0.986 seconds
2019-01-20 20:02:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:02:37 [DEBUG   ] Got command BAM from MCS: ref #1231621
2019-01-20 20:02:37 [INFO    ] Finished processing BAM request
2019-01-20 20:02:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:02:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231621   8 58503 72157029 A  ERROR'
2019-01-20 20:02:37 [DEBUG   ] Got command BAM from MCS: ref #1231620
2019-01-20 20:02:37 [INFO    ] Finished processing BAM request
2019-01-20 20:02:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:02:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231620   8 58503 72157033 A  ERROR'
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:02:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:02:37 [DEBUG   ] spawn_process: at 2019-01-20 20:02:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:02:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:03:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:03:16 [DEBUG   ] Got command BAM from MCS: ref #1231622
2019-01-20 20:03:16 [INFO    ] Finished processing BAM request
2019-01-20 20:03:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231622   8 58503 72196041 A  ERROR'
2019-01-20 20:03:16 [DEBUG   ] Got command BAM from MCS: ref #1231623
2019-01-20 20:03:16 [INFO    ] Finished processing BAM request
2019-01-20 20:03:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231623   8 58503 72196049 A  ERROR'
2019-01-20 20:03:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 20:03:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:03:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 20:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 20:03:16 [DEBUG   ] spawn_process: at 2019-01-20 20:03:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 20:03:17 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:03:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:03:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:03:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:03:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:03:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:03:17 [DEBUG   ] Finished updating board flags in 1.805 seconds
2019-01-20 20:03:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:03:27 [DEBUG   ] Got command RPT from MCS: ref #1231624
2019-01-20 20:03:27 [DEBUG   ] summary = ERROR
2019-01-20 20:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231624  13 58503 72207535 A  ERRORERROR'
2019-01-20 20:03:27 [DEBUG   ] Got command RPT from MCS: ref #1231625
2019-01-20 20:03:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231625  77 58503 72207737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:03:27 [DEBUG   ] Got command RPT from MCS: ref #1231626
2019-01-20 20:03:27 [DEBUG   ] summary = ERROR
2019-01-20 20:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231626  13 58503 72207941 A  ERRORERROR'
2019-01-20 20:03:28 [DEBUG   ] Got command RPT from MCS: ref #1231627
2019-01-20 20:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231627  77 58503 72208133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:03:28 [DEBUG   ] Got command RPT from MCS: ref #1231628
2019-01-20 20:03:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 20:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231628  12 58503 72208337 A  ERRORB£ff'
2019-01-20 20:03:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:03:55 [DEBUG   ] Got command BAM from MCS: ref #1231629
2019-01-20 20:03:55 [INFO    ] Finished processing BAM request
2019-01-20 20:03:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231629   8 58503 72235029 A  ERROR'
2019-01-20 20:03:55 [DEBUG   ] Got command BAM from MCS: ref #1231630
2019-01-20 20:03:55 [INFO    ] Finished processing BAM request
2019-01-20 20:03:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231630   8 58503 72235033 A  ERROR'
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:03:55 [DEBUG   ] spawn_process: at 2019-01-20 20:03:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:04:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:04:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-20 20:04:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:04:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 20:04:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 20:04:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:04:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 20:04:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:04:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:04:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:04:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:04:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:04:16 [DEBUG   ] Finished updating board flags in 1.241 seconds
2019-01-20 20:04:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 20:04:34 [DEBUG   ] Got command BAM from MCS: ref #1231631
2019-01-20 20:04:34 [INFO    ] Finished processing BAM request
2019-01-20 20:04:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:04:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231631   8 58503 72274029 A  ERROR'
2019-01-20 20:04:34 [DEBUG   ] Got command BAM from MCS: ref #1231632
2019-01-20 20:04:34 [INFO    ] Finished processing BAM request
2019-01-20 20:04:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:04:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231632   8 58503 72274033 A  ERROR'
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:04:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:04:34 [DEBUG   ] spawn_process: at 2019-01-20 20:04:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:04:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 20:05:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 20:05:13 [DEBUG   ] Got command BAM from MCS: ref #1231638
2019-01-20 20:05:13 [INFO    ] Finished processing BAM request
2019-01-20 20:05:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231638   8 58503 72313029 A  ERROR'
2019-01-20 20:05:13 [DEBUG   ] Got command BAM from MCS: ref #1231637
2019-01-20 20:05:13 [INFO    ] Finished processing BAM request
2019-01-20 20:05:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231637   8 58503 72313033 A  ERROR'
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:05:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:05:13 [DEBUG   ] spawn_process: at 2019-01-20 20:05:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:05:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:05:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 20:05:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:05:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:05:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 20:05:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:05:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:05:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:05:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:05:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:05:16 [DEBUG   ] Finished updating board flags in 1.222 seconds
2019-01-20 20:05:25 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-20 20:05:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:05:52 [DEBUG   ] Got command BAM from MCS: ref #1231640
2019-01-20 20:05:52 [INFO    ] Finished processing BAM request
2019-01-20 20:05:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:05:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231640   8 58503 72352029 A  ERROR'
2019-01-20 20:05:52 [DEBUG   ] Got command BAM from MCS: ref #1231639
2019-01-20 20:05:52 [INFO    ] Finished processing BAM request
2019-01-20 20:05:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:05:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231639   8 58503 72352033 A  ERROR'
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:05:52 [DEBUG   ] spawn_process: at 2019-01-20 20:05:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:06:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:06:06 [DEBUG   ] Got command RPT from MCS: ref #1231641
2019-01-20 20:06:06 [DEBUG   ] summary = ERROR
2019-01-20 20:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231641  13 58503 72366741 A  ERRORERROR'
2019-01-20 20:06:06 [DEBUG   ] Got command RPT from MCS: ref #1231642
2019-01-20 20:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231642  77 58503 72366742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:06:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:06:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:06:17 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:06:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 20:06:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:06:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:06:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:06:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:06:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:06:17 [DEBUG   ] Finished updating board flags in 1.757 seconds
2019-01-20 20:06:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:06:31 [DEBUG   ] Got command BAM from MCS: ref #1231658
2019-01-20 20:06:31 [INFO    ] Finished processing BAM request
2019-01-20 20:06:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:06:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231658   8 58503 72391033 A  ERROR'
2019-01-20 20:06:31 [DEBUG   ] Got command BAM from MCS: ref #1231659
2019-01-20 20:06:31 [INFO    ] Finished processing BAM request
2019-01-20 20:06:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:06:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231659   8 58503 72391037 A  ERROR'
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:06:31 [DEBUG   ] spawn_process: at 2019-01-20 20:06:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:06:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:07:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:07:10 [DEBUG   ] Got command BAM from MCS: ref #1231661
2019-01-20 20:07:10 [INFO    ] Finished processing BAM request
2019-01-20 20:07:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:07:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231661   8 58503 72430025 A  ERROR'
2019-01-20 20:07:10 [DEBUG   ] Got command BAM from MCS: ref #1231660
2019-01-20 20:07:10 [INFO    ] Finished processing BAM request
2019-01-20 20:07:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:07:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231660   8 58503 72430029 A  ERROR'
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 20:07:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 20:07:10 [DEBUG   ] spawn_process: at 2019-01-20 20:07:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 20:07:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:07:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:07:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:07:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:07:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:07:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:07:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:07:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:07:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:07:16 [DEBUG   ] Finished updating board flags in 1.022 seconds
2019-01-20 20:07:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:07:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:07:49 [DEBUG   ] Got command BAM from MCS: ref #1231666
2019-01-20 20:07:49 [INFO    ] Finished processing BAM request
2019-01-20 20:07:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:07:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231666   8 58503 72469025 A  ERROR'
2019-01-20 20:07:49 [DEBUG   ] Got command BAM from MCS: ref #1231667
2019-01-20 20:07:49 [INFO    ] Finished processing BAM request
2019-01-20 20:07:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:07:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231667   8 58503 72469029 A  ERROR'
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 20:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 20:07:49 [DEBUG   ] spawn_process: at 2019-01-20 20:07:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 20:08:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:08:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:08:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:08:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:08:17 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:08:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:08:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:08:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:08:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:08:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:08:17 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-20 20:08:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:08:27 [DEBUG   ] Got command RPT from MCS: ref #1231672
2019-01-20 20:08:27 [DEBUG   ] summary = ERROR
2019-01-20 20:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231672  13 58503 72507613 A  ERRORERROR'
2019-01-20 20:08:27 [DEBUG   ] Got command RPT from MCS: ref #1231673
2019-01-20 20:08:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231673  77 58503 72507817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:08:28 [DEBUG   ] Got command RPT from MCS: ref #1231674
2019-01-20 20:08:28 [DEBUG   ] summary = ERROR
2019-01-20 20:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231674  13 58503 72508021 A  ERRORERROR'
2019-01-20 20:08:28 [DEBUG   ] Got command BAM from MCS: ref #1231671
2019-01-20 20:08:28 [INFO    ] Finished processing BAM request
2019-01-20 20:08:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231671   8 58503 72508025 A  ERROR'
2019-01-20 20:08:28 [DEBUG   ] Got command BAM from MCS: ref #1231670
2019-01-20 20:08:28 [INFO    ] Finished processing BAM request
2019-01-20 20:08:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231670   8 58503 72508029 A  ERROR'
2019-01-20 20:08:28 [DEBUG   ] Got command RPT from MCS: ref #1231676
2019-01-20 20:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231676  77 58503 72508221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:08:28 [DEBUG   ] Got command RPT from MCS: ref #1231677
2019-01-20 20:08:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 20:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231677  12 58503 72508425 A  ERRORB£ff'
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 20:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 20:08:28 [DEBUG   ] spawn_process: at 2019-01-20 20:08:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 20:08:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:09:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:09:07 [DEBUG   ] Got command BAM from MCS: ref #1231683
2019-01-20 20:09:07 [INFO    ] Finished processing BAM request
2019-01-20 20:09:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:09:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231683   8 58503 72547025 A  ERROR'
2019-01-20 20:09:07 [DEBUG   ] Got command BAM from MCS: ref #1231682
2019-01-20 20:09:07 [INFO    ] Finished processing BAM request
2019-01-20 20:09:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:09:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231682   8 58503 72547029 A  ERROR'
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:09:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:09:07 [DEBUG   ] spawn_process: at 2019-01-20 20:09:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:09:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:09:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 20:09:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:09:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 20:09:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-20 20:09:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:09:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:09:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:09:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:09:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:09:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:09:16 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-20 20:09:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:09:46 [DEBUG   ] Got command BAM from MCS: ref #1231684
2019-01-20 20:09:46 [INFO    ] Finished processing BAM request
2019-01-20 20:09:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:09:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231684   8 58503 72586033 A  ERROR'
2019-01-20 20:09:46 [DEBUG   ] Got command BAM from MCS: ref #1231685
2019-01-20 20:09:46 [INFO    ] Finished processing BAM request
2019-01-20 20:09:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:09:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231685   8 58503 72586037 A  ERROR'
2019-01-20 20:09:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:09:46 [DEBUG   ] spawn_process: at 2019-01-20 20:09:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:10:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:10:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:10:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:10:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:10:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:10:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:10:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:10:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:10:16 [DEBUG   ] Finished updating board flags in 1.026 seconds
2019-01-20 20:10:25 [DEBUG   ] Got command BAM from MCS: ref #1231686
2019-01-20 20:10:25 [INFO    ] Finished processing BAM request
2019-01-20 20:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231686   8 58503 72625033 A  ERROR'
2019-01-20 20:10:25 [DEBUG   ] Got command BAM from MCS: ref #1231687
2019-01-20 20:10:25 [INFO    ] Finished processing BAM request
2019-01-20 20:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231687   8 58503 72625037 A  ERROR'
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:10:25 [DEBUG   ] spawn_process: at 2019-01-20 20:10:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:10:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:10:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:11:04 [DEBUG   ] Got command BAM from MCS: ref #1231692
2019-01-20 20:11:04 [INFO    ] Finished processing BAM request
2019-01-20 20:11:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231692   8 58503 72664025 A  ERROR'
2019-01-20 20:11:04 [DEBUG   ] Got command BAM from MCS: ref #1231693
2019-01-20 20:11:04 [INFO    ] Finished processing BAM request
2019-01-20 20:11:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231693   8 58503 72664029 A  ERROR'
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 20:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 20:11:04 [DEBUG   ] spawn_process: at 2019-01-20 20:11:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 20:11:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:11:06 [DEBUG   ] Got command RPT from MCS: ref #1231694
2019-01-20 20:11:06 [DEBUG   ] summary = ERROR
2019-01-20 20:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231694  13 58503 72666749 A  ERRORERROR'
2019-01-20 20:11:06 [DEBUG   ] Got command RPT from MCS: ref #1231695
2019-01-20 20:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231695  77 58503 72666750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:11:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:11:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:11:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 20:11:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:11:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:11:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:11:16 [WARNING ] (13, 1, 'bot')
2019-01-20 20:11:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:11:16 [DEBUG   ] Finished updating board flags in 0.967 seconds
2019-01-20 20:11:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:11:43 [DEBUG   ] Got command BAM from MCS: ref #1231711
2019-01-20 20:11:43 [INFO    ] Finished processing BAM request
2019-01-20 20:11:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231711   8 58503 72703025 A  ERROR'
2019-01-20 20:11:43 [DEBUG   ] Got command BAM from MCS: ref #1231712
2019-01-20 20:11:43 [INFO    ] Finished processing BAM request
2019-01-20 20:11:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231712   8 58503 72703029 A  ERROR'
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 20:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 20:11:43 [DEBUG   ] spawn_process: at 2019-01-20 20:11:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 20:11:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:12:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:12:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 20:12:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:12:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 20:12:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:12:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:12:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:12:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:12:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:12:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:12:17 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-01-20 20:12:22 [DEBUG   ] Got command BAM from MCS: ref #1231713
2019-01-20 20:12:22 [INFO    ] Finished processing BAM request
2019-01-20 20:12:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231713   8 58503 72742025 A  ERROR'
2019-01-20 20:12:22 [DEBUG   ] Got command BAM from MCS: ref #1231714
2019-01-20 20:12:22 [INFO    ] Finished processing BAM request
2019-01-20 20:12:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231714   8 58503 72742029 A  ERROR'
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:12:22 [DEBUG   ] spawn_process: at 2019-01-20 20:12:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:12:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:12:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:13:01 [DEBUG   ] Got command BAM from MCS: ref #1231716
2019-01-20 20:13:01 [INFO    ] Finished processing BAM request
2019-01-20 20:13:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:13:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231716   8 58503 72781025 A  ERROR'
2019-01-20 20:13:01 [DEBUG   ] Got command BAM from MCS: ref #1231715
2019-01-20 20:13:01 [INFO    ] Finished processing BAM request
2019-01-20 20:13:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:13:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231715   8 58503 72781029 A  ERROR'
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:13:01 [DEBUG   ] spawn_process: at 2019-01-20 20:13:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:13:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:13:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:13:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:13:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:13:17 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:13:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 20:13:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:13:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:13:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:13:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:13:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:13:17 [DEBUG   ] Finished updating board flags in 1.175 seconds
2019-01-20 20:13:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:13:27 [DEBUG   ] Got command RPT from MCS: ref #1231717
2019-01-20 20:13:27 [DEBUG   ] summary = ERROR
2019-01-20 20:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231717  13 58503 72807709 A  ERRORERROR'
2019-01-20 20:13:27 [DEBUG   ] Got command RPT from MCS: ref #1231718
2019-01-20 20:13:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231718  77 58503 72807902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:13:28 [DEBUG   ] Got command RPT from MCS: ref #1231719
2019-01-20 20:13:28 [DEBUG   ] summary = ERROR
2019-01-20 20:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231719  13 58503 72808105 A  ERRORERROR'
2019-01-20 20:13:28 [DEBUG   ] Got command RPT from MCS: ref #1231720
2019-01-20 20:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231720  77 58503 72808309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:13:28 [DEBUG   ] Got command RPT from MCS: ref #1231721
2019-01-20 20:13:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 20:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231721  12 58503 72808513 A  ERRORB£ff'
2019-01-20 20:13:40 [DEBUG   ] Got command BAM from MCS: ref #1231726
2019-01-20 20:13:40 [INFO    ] Finished processing BAM request
2019-01-20 20:13:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231726   8 58503 72820025 A  ERROR'
2019-01-20 20:13:40 [DEBUG   ] Got command BAM from MCS: ref #1231727
2019-01-20 20:13:40 [INFO    ] Finished processing BAM request
2019-01-20 20:13:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231727   8 58503 72820029 A  ERROR'
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:13:40 [DEBUG   ] spawn_process: at 2019-01-20 20:13:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:13:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:14:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:14:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 20:14:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:14:17 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:14:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:14:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:14:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:14:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:14:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:14:17 [DEBUG   ] Finished updating board flags in 1.024 seconds
2019-01-20 20:14:19 [DEBUG   ] Got command BAM from MCS: ref #1231729
2019-01-20 20:14:19 [INFO    ] Finished processing BAM request
2019-01-20 20:14:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:14:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231729   8 58503 72859033 A  ERROR'
2019-01-20 20:14:19 [DEBUG   ] Got command BAM from MCS: ref #1231728
2019-01-20 20:14:19 [INFO    ] Finished processing BAM request
2019-01-20 20:14:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:14:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231728   8 58503 72859037 A  ERROR'
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:14:19 [DEBUG   ] spawn_process: at 2019-01-20 20:14:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:14:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:14:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:14:58 [DEBUG   ] Got command BAM from MCS: ref #1231731
2019-01-20 20:14:58 [INFO    ] Finished processing BAM request
2019-01-20 20:14:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231731   8 58503 72898033 A  ERROR'
2019-01-20 20:14:58 [DEBUG   ] Got command BAM from MCS: ref #1231730
2019-01-20 20:14:58 [INFO    ] Finished processing BAM request
2019-01-20 20:14:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231730   8 58503 72898037 A  ERROR'
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:14:58 [DEBUG   ] spawn_process: at 2019-01-20 20:14:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:15:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:15:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:15:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:15:17 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:15:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:15:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:15:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:15:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:15:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:15:17 [DEBUG   ] Finished updating board flags in 1.077 seconds
2019-01-20 20:15:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:15:37 [DEBUG   ] Got command BAM from MCS: ref #1231733
2019-01-20 20:15:37 [INFO    ] Finished processing BAM request
2019-01-20 20:15:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231733   8 58503 72937033 A  ERROR'
2019-01-20 20:15:37 [DEBUG   ] Got command BAM from MCS: ref #1231732
2019-01-20 20:15:37 [INFO    ] Finished processing BAM request
2019-01-20 20:15:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231732   8 58503 72937037 A  ERROR'
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:15:37 [DEBUG   ] spawn_process: at 2019-01-20 20:15:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:15:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:16:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:16:06 [DEBUG   ] Got command RPT from MCS: ref #1231734
2019-01-20 20:16:06 [DEBUG   ] summary = ERROR
2019-01-20 20:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231734  13 58503 72966749 A  ERRORERROR'
2019-01-20 20:16:06 [DEBUG   ] Got command RPT from MCS: ref #1231735
2019-01-20 20:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231735  77 58503 72966750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:16:16 [DEBUG   ] Got command BAM from MCS: ref #1231751
2019-01-20 20:16:16 [INFO    ] Finished processing BAM request
2019-01-20 20:16:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:16:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231751   8 58503 72976029 A  ERROR'
2019-01-20 20:16:16 [DEBUG   ] Got command BAM from MCS: ref #1231752
2019-01-20 20:16:16 [INFO    ] Finished processing BAM request
2019-01-20 20:16:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:16:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231752   8 58503 72976033 A  ERROR'
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:16:16 [DEBUG   ] spawn_process: at 2019-01-20 20:16:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:16:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 20:16:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:16:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:16:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:16:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 20:16:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:16:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:16:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:16:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:16:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:16:17 [DEBUG   ] Finished updating board flags in 1.438 seconds
2019-01-20 20:16:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:16:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:16:55 [DEBUG   ] Got command BAM from MCS: ref #1231758
2019-01-20 20:16:55 [INFO    ] Finished processing BAM request
2019-01-20 20:16:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231758   8 58503 73015029 A  ERROR'
2019-01-20 20:16:55 [DEBUG   ] Got command BAM from MCS: ref #1231757
2019-01-20 20:16:55 [INFO    ] Finished processing BAM request
2019-01-20 20:16:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231757   8 58503 73015033 A  ERROR'
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:16:55 [DEBUG   ] spawn_process: at 2019-01-20 20:16:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:17:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:17:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 20:17:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-20 20:17:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:17:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:17:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:17:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:17:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:17:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:17:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:17:18 [DEBUG   ] Finished updating board flags in 1.957 seconds
2019-01-20 20:17:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:17:34 [DEBUG   ] Got command BAM from MCS: ref #1231760
2019-01-20 20:17:34 [INFO    ] Finished processing BAM request
2019-01-20 20:17:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231760   8 58503 73054029 A  ERROR'
2019-01-20 20:17:34 [DEBUG   ] Got command BAM from MCS: ref #1231759
2019-01-20 20:17:34 [INFO    ] Finished processing BAM request
2019-01-20 20:17:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231759   8 58503 73054033 A  ERROR'
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 20:17:34 [DEBUG   ] spawn_process: at 2019-01-20 20:17:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 20:17:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:18:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:18:13 [DEBUG   ] Got command BAM from MCS: ref #1231763
2019-01-20 20:18:13 [INFO    ] Finished processing BAM request
2019-01-20 20:18:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:18:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231763   8 58503 73093033 A  ERROR'
2019-01-20 20:18:13 [DEBUG   ] Got command BAM from MCS: ref #1231764
2019-01-20 20:18:13 [INFO    ] Finished processing BAM request
2019-01-20 20:18:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:18:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231764   8 58503 73093037 A  ERROR'
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:18:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:18:13 [DEBUG   ] spawn_process: at 2019-01-20 20:18:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:18:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:18:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:18:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 20:18:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:18:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:18:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:18:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:18:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:18:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:18:17 [DEBUG   ] Finished updating board flags in 1.156 seconds
2019-01-20 20:18:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:18:27 [DEBUG   ] Got command RPT from MCS: ref #1231765
2019-01-20 20:18:27 [DEBUG   ] summary = ERROR
2019-01-20 20:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231765  13 58503 73107785 A  ERRORERROR'
2019-01-20 20:18:27 [DEBUG   ] Got command RPT from MCS: ref #1231766
2019-01-20 20:18:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231766  77 58503 73107989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:18:28 [DEBUG   ] Got command RPT from MCS: ref #1231767
2019-01-20 20:18:28 [DEBUG   ] summary = ERROR
2019-01-20 20:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231767  13 58503 73108193 A  ERRORERROR'
2019-01-20 20:18:28 [DEBUG   ] Got command RPT from MCS: ref #1231769
2019-01-20 20:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231769  77 58503 73108397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:18:28 [DEBUG   ] Got command RPT from MCS: ref #1231770
2019-01-20 20:18:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 20:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231770  12 58503 73108589 A  ERRORB¢ff'
2019-01-20 20:18:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:18:52 [DEBUG   ] Got command BAM from MCS: ref #1231776
2019-01-20 20:18:52 [INFO    ] Finished processing BAM request
2019-01-20 20:18:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:18:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231776   8 58503 73132029 A  ERROR'
2019-01-20 20:18:52 [DEBUG   ] Got command BAM from MCS: ref #1231775
2019-01-20 20:18:52 [INFO    ] Finished processing BAM request
2019-01-20 20:18:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:18:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231775   8 58503 73132033 A  ERROR'
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:18:52 [DEBUG   ] spawn_process: at 2019-01-20 20:18:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:19:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:19:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:19:17 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:19:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:19:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:19:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:19:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:19:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:19:17 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-01-20 20:19:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:19:31 [DEBUG   ] Got command BAM from MCS: ref #1231778
2019-01-20 20:19:31 [INFO    ] Finished processing BAM request
2019-01-20 20:19:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:19:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231778   8 58503 73171025 A  ERROR'
2019-01-20 20:19:31 [DEBUG   ] Got command BAM from MCS: ref #1231777
2019-01-20 20:19:31 [INFO    ] Finished processing BAM request
2019-01-20 20:19:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:19:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231777   8 58503 73171029 A  ERROR'
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:19:31 [DEBUG   ] spawn_process: at 2019-01-20 20:19:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:19:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:20:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:20:10 [DEBUG   ] Got command BAM from MCS: ref #1231783
2019-01-20 20:20:10 [INFO    ] Finished processing BAM request
2019-01-20 20:20:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231783   8 58503 73210029 A  ERROR'
2019-01-20 20:20:10 [DEBUG   ] Got command BAM from MCS: ref #1231784
2019-01-20 20:20:10 [INFO    ] Finished processing BAM request
2019-01-20 20:20:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231784   8 58503 73210033 A  ERROR'
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:20:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:20:10 [DEBUG   ] spawn_process: at 2019-01-20 20:20:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:20:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:20:17 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:20:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 20:20:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:20:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:20:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:20:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:20:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:20:17 [DEBUG   ] Finished updating board flags in 1.014 seconds
2019-01-20 20:20:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:20:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:20:49 [DEBUG   ] Got command BAM from MCS: ref #1231786
2019-01-20 20:20:49 [INFO    ] Finished processing BAM request
2019-01-20 20:20:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231786   8 58503 73249033 A  ERROR'
2019-01-20 20:20:49 [DEBUG   ] Got command BAM from MCS: ref #1231785
2019-01-20 20:20:49 [INFO    ] Finished processing BAM request
2019-01-20 20:20:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231785   8 58503 73249037 A  ERROR'
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:20:49 [DEBUG   ] spawn_process: at 2019-01-20 20:20:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:21:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:21:06 [DEBUG   ] Got command RPT from MCS: ref #1231787
2019-01-20 20:21:06 [DEBUG   ] summary = ERROR
2019-01-20 20:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231787  13 58503 73266771 A  ERRORERROR'
2019-01-20 20:21:06 [DEBUG   ] Got command RPT from MCS: ref #1231788
2019-01-20 20:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231788  77 58503 73266771 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:21:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 20:21:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:21:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-20 20:21:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:21:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 20:21:17 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:21:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:21:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:21:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:21:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:21:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:21:17 [DEBUG   ] Finished updating board flags in 1.003 seconds
2019-01-20 20:21:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:21:28 [DEBUG   ] Got command BAM from MCS: ref #1231805
2019-01-20 20:21:28 [INFO    ] Finished processing BAM request
2019-01-20 20:21:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:21:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231805   8 58503 73288033 A  ERROR'
2019-01-20 20:21:28 [DEBUG   ] Got command BAM from MCS: ref #1231804
2019-01-20 20:21:28 [INFO    ] Finished processing BAM request
2019-01-20 20:21:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:21:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231804   8 58503 73288037 A  ERROR'
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:21:28 [DEBUG   ] spawn_process: at 2019-01-20 20:21:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:21:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:22:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:22:07 [DEBUG   ] Got command BAM from MCS: ref #1231807
2019-01-20 20:22:07 [INFO    ] Finished processing BAM request
2019-01-20 20:22:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:22:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231807   8 58503 73327029 A  ERROR'
2019-01-20 20:22:07 [DEBUG   ] Got command BAM from MCS: ref #1231806
2019-01-20 20:22:07 [INFO    ] Finished processing BAM request
2019-01-20 20:22:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:22:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231806   8 58503 73327033 A  ERROR'
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:22:07 [DEBUG   ] spawn_process: at 2019-01-20 20:22:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:22:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 20:22:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:22:17 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:22:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 20:22:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:22:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:22:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:22:17 [WARNING ] (13, 1, 'bot')
2019-01-20 20:22:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:22:17 [DEBUG   ] Finished updating board flags in 1.027 seconds
2019-01-20 20:22:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:22:46 [DEBUG   ] Got command BAM from MCS: ref #1231813
2019-01-20 20:22:46 [INFO    ] Finished processing BAM request
2019-01-20 20:22:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:22:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231813   8 58503 73366029 A  ERROR'
2019-01-20 20:22:46 [DEBUG   ] Got command BAM from MCS: ref #1231812
2019-01-20 20:22:46 [INFO    ] Finished processing BAM request
2019-01-20 20:22:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:22:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231812   8 58503 73366033 A  ERROR'
2019-01-20 20:22:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 20:22:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 20:22:46 [DEBUG   ] spawn_process: at 2019-01-20 20:22:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 20:23:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:23:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 20:23:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 20:23:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:23:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:23:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:23:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:23:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:23:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:23:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:23:18 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-01-20 20:23:25 [DEBUG   ] Got command BAM from MCS: ref #1231814
2019-01-20 20:23:25 [INFO    ] Finished processing BAM request
2019-01-20 20:23:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231814   8 58503 73405026 A  ERROR'
2019-01-20 20:23:25 [DEBUG   ] Got command BAM from MCS: ref #1231815
2019-01-20 20:23:25 [INFO    ] Finished processing BAM request
2019-01-20 20:23:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231815   8 58503 73405030 A  ERROR'
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:23:25 [DEBUG   ] spawn_process: at 2019-01-20 20:23:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:23:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:23:27 [DEBUG   ] Got command RPT from MCS: ref #1231816
2019-01-20 20:23:27 [DEBUG   ] summary = ERROR
2019-01-20 20:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231816  13 58503 73407874 A  ERRORERROR'
2019-01-20 20:23:28 [DEBUG   ] Got command RPT from MCS: ref #1231817
2019-01-20 20:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231817  77 58503 73408077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:23:28 [DEBUG   ] Got command RPT from MCS: ref #1231818
2019-01-20 20:23:28 [DEBUG   ] summary = ERROR
2019-01-20 20:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231818  13 58503 73408281 A  ERRORERROR'
2019-01-20 20:23:28 [DEBUG   ] Got command RPT from MCS: ref #1231819
2019-01-20 20:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231819  77 58503 73408474 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:23:28 [DEBUG   ] Got command RPT from MCS: ref #1231820
2019-01-20 20:23:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 20:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231820  12 58503 73408678 A  ERRORB£ff'
2019-01-20 20:23:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:24:04 [DEBUG   ] Got command BAM from MCS: ref #1231821
2019-01-20 20:24:04 [INFO    ] Finished processing BAM request
2019-01-20 20:24:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:24:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231821   8 58503 73444034 A  ERROR'
2019-01-20 20:24:04 [DEBUG   ] Got command BAM from MCS: ref #1231822
2019-01-20 20:24:04 [INFO    ] Finished processing BAM request
2019-01-20 20:24:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:24:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231822   8 58503 73444038 A  ERROR'
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:24:04 [DEBUG   ] spawn_process: at 2019-01-20 20:24:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:24:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:24:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:24:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 20:24:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:24:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:24:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 20:24:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:24:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:24:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:24:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:24:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:24:18 [DEBUG   ] Finished updating board flags in 1.317 seconds
2019-01-20 20:24:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:24:43 [DEBUG   ] Got command BAM from MCS: ref #1231824
2019-01-20 20:24:43 [INFO    ] Finished processing BAM request
2019-01-20 20:24:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:24:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231824   8 58503 73483030 A  ERROR'
2019-01-20 20:24:43 [DEBUG   ] Got command BAM from MCS: ref #1231823
2019-01-20 20:24:43 [INFO    ] Finished processing BAM request
2019-01-20 20:24:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:24:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231823   8 58503 73483034 A  ERROR'
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:24:43 [DEBUG   ] spawn_process: at 2019-01-20 20:24:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:24:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:25:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:25:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 20:25:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:25:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:25:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:25:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:25:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:25:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:25:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:25:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:25:18 [DEBUG   ] Finished updating board flags in 1.217 seconds
2019-01-20 20:25:22 [DEBUG   ] Got command BAM from MCS: ref #1231826
2019-01-20 20:25:22 [INFO    ] Finished processing BAM request
2019-01-20 20:25:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:25:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231826   8 58503 73522026 A  ERROR'
2019-01-20 20:25:22 [DEBUG   ] Got command BAM from MCS: ref #1231825
2019-01-20 20:25:22 [INFO    ] Finished processing BAM request
2019-01-20 20:25:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:25:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231825   8 58503 73522030 A  ERROR'
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:25:22 [DEBUG   ] spawn_process: at 2019-01-20 20:25:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:25:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:25:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:26:01 [DEBUG   ] Got command BAM from MCS: ref #1231832
2019-01-20 20:26:01 [INFO    ] Finished processing BAM request
2019-01-20 20:26:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:26:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231832   8 58503 73561034 A  ERROR'
2019-01-20 20:26:01 [DEBUG   ] Got command BAM from MCS: ref #1231831
2019-01-20 20:26:01 [INFO    ] Finished processing BAM request
2019-01-20 20:26:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:26:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231831   8 58503 73561038 A  ERROR'
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:26:01 [DEBUG   ] spawn_process: at 2019-01-20 20:26:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:26:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:26:06 [DEBUG   ] Got command RPT from MCS: ref #1231833
2019-01-20 20:26:06 [DEBUG   ] summary = ERROR
2019-01-20 20:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231833  13 58503 73566749 A  ERRORERROR'
2019-01-20 20:26:06 [DEBUG   ] Got command RPT from MCS: ref #1231834
2019-01-20 20:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231834  77 58503 73566750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:26:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:26:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 20:26:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:26:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:26:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:26:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:26:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:26:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:26:18 [DEBUG   ] Finished updating board flags in 1.188 seconds
2019-01-20 20:26:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:26:40 [DEBUG   ] Got command BAM from MCS: ref #1231850
2019-01-20 20:26:40 [INFO    ] Finished processing BAM request
2019-01-20 20:26:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231850   8 58503 73600030 A  ERROR'
2019-01-20 20:26:40 [DEBUG   ] Got command BAM from MCS: ref #1231851
2019-01-20 20:26:40 [INFO    ] Finished processing BAM request
2019-01-20 20:26:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231851   8 58503 73600034 A  ERROR'
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:26:40 [DEBUG   ] spawn_process: at 2019-01-20 20:26:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:26:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:27:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:27:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:27:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:27:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:27:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:27:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:27:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:27:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:27:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:27:18 [DEBUG   ] Finished updating board flags in 1.012 seconds
2019-01-20 20:27:19 [DEBUG   ] Got command BAM from MCS: ref #1231852
2019-01-20 20:27:19 [INFO    ] Finished processing BAM request
2019-01-20 20:27:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231852   8 58503 73639026 A  ERROR'
2019-01-20 20:27:19 [DEBUG   ] Got command BAM from MCS: ref #1231853
2019-01-20 20:27:19 [INFO    ] Finished processing BAM request
2019-01-20 20:27:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231853   8 58503 73639030 A  ERROR'
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:27:19 [DEBUG   ] spawn_process: at 2019-01-20 20:27:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:27:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:27:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:27:58 [DEBUG   ] Got command BAM from MCS: ref #1231855
2019-01-20 20:27:58 [INFO    ] Finished processing BAM request
2019-01-20 20:27:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:27:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231855   8 58503 73678029 A  ERROR'
2019-01-20 20:27:58 [DEBUG   ] Got command BAM from MCS: ref #1231854
2019-01-20 20:27:58 [INFO    ] Finished processing BAM request
2019-01-20 20:27:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:27:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231854   8 58503 73678033 A  ERROR'
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:27:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:27:58 [DEBUG   ] spawn_process: at 2019-01-20 20:27:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:28:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 20:28:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:28:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:28:18 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:28:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:28:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:28:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:28:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:28:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:28:18 [DEBUG   ] Finished updating board flags in 1.054 seconds
2019-01-20 20:28:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 20:28:27 [DEBUG   ] Got command RPT from MCS: ref #1231858
2019-01-20 20:28:27 [DEBUG   ] summary = ERROR
2019-01-20 20:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231858  13 58503 73707969 A  ERRORERROR'
2019-01-20 20:28:28 [DEBUG   ] Got command RPT from MCS: ref #1231859
2019-01-20 20:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231859  77 58503 73708161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:28:28 [DEBUG   ] Got command RPT from MCS: ref #1231860
2019-01-20 20:28:28 [DEBUG   ] summary = ERROR
2019-01-20 20:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231860  13 58503 73708365 A  ERRORERROR'
2019-01-20 20:28:28 [DEBUG   ] Got command RPT from MCS: ref #1231862
2019-01-20 20:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231862  77 58503 73708569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:28:28 [DEBUG   ] Got command RPT from MCS: ref #1231863
2019-01-20 20:28:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 20:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231863  12 58503 73708761 A  ERRORB¡ff'
2019-01-20 20:28:37 [DEBUG   ] Got command BAM from MCS: ref #1231868
2019-01-20 20:28:37 [INFO    ] Finished processing BAM request
2019-01-20 20:28:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231868   8 58503 73717033 A  ERROR'
2019-01-20 20:28:37 [DEBUG   ] Got command BAM from MCS: ref #1231869
2019-01-20 20:28:37 [INFO    ] Finished processing BAM request
2019-01-20 20:28:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231869   8 58503 73717037 A  ERROR'
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:28:37 [DEBUG   ] spawn_process: at 2019-01-20 20:28:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:28:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 20:29:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 20:29:16 [DEBUG   ] Got command BAM from MCS: ref #1231875
2019-01-20 20:29:16 [INFO    ] Finished processing BAM request
2019-01-20 20:29:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:29:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231875   8 58503 73756033 A  ERROR'
2019-01-20 20:29:16 [DEBUG   ] Got command BAM from MCS: ref #1231874
2019-01-20 20:29:16 [INFO    ] Finished processing BAM request
2019-01-20 20:29:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:29:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231874   8 58503 73756037 A  ERROR'
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:29:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:29:16 [DEBUG   ] spawn_process: at 2019-01-20 20:29:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:29:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:29:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:29:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:29:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:29:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:29:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:29:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:29:18 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-01-20 20:29:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 20:29:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 20:29:55 [DEBUG   ] Got command BAM from MCS: ref #1231877
2019-01-20 20:29:55 [INFO    ] Finished processing BAM request
2019-01-20 20:29:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:29:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231877   8 58503 73795029 A  ERROR'
2019-01-20 20:29:55 [DEBUG   ] Got command BAM from MCS: ref #1231876
2019-01-20 20:29:55 [INFO    ] Finished processing BAM request
2019-01-20 20:29:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:29:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231876   8 58503 73795033 A  ERROR'
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:29:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:29:55 [DEBUG   ] spawn_process: at 2019-01-20 20:29:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:30:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 20:30:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:30:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:30:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:30:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:30:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:30:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:30:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:30:18 [DEBUG   ] Finished updating board flags in 1.343 seconds
2019-01-20 20:30:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 20:30:34 [DEBUG   ] Got command BAM from MCS: ref #1231879
2019-01-20 20:30:34 [INFO    ] Finished processing BAM request
2019-01-20 20:30:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:30:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231879   8 58503 73834033 A  ERROR'
2019-01-20 20:30:34 [DEBUG   ] Got command BAM from MCS: ref #1231878
2019-01-20 20:30:34 [INFO    ] Finished processing BAM request
2019-01-20 20:30:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:30:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231878   8 58503 73834037 A  ERROR'
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:30:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:30:34 [DEBUG   ] spawn_process: at 2019-01-20 20:30:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:30:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 20:31:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 20:31:06 [DEBUG   ] Got command RPT from MCS: ref #1231880
2019-01-20 20:31:06 [DEBUG   ] summary = ERROR
2019-01-20 20:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231880  13 58503 73866757 A  ERRORERROR'
2019-01-20 20:31:06 [DEBUG   ] Got command RPT from MCS: ref #1231881
2019-01-20 20:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231881  77 58503 73866758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:31:14 [DEBUG   ] Got command BAM from MCS: ref #1231898
2019-01-20 20:31:14 [INFO    ] Finished processing BAM request
2019-01-20 20:31:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231898   8 58503 73874029 A  ERROR'
2019-01-20 20:31:14 [DEBUG   ] Got command BAM from MCS: ref #1231897
2019-01-20 20:31:14 [INFO    ] Finished processing BAM request
2019-01-20 20:31:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231897   8 58503 73874033 A  ERROR'
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:31:14 [DEBUG   ] spawn_process: at 2019-01-20 20:31:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:31:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:31:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:31:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:31:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:31:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:31:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:31:18 [WARNING ] (13, 1, 'bot')
2019-01-20 20:31:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:31:18 [DEBUG   ] Finished updating board flags in 1.179 seconds
2019-01-20 20:31:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 20:31:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 20:31:54 [DEBUG   ] Got command BAM from MCS: ref #1231904
2019-01-20 20:31:54 [INFO    ] Finished processing BAM request
2019-01-20 20:31:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231904   8 58503 73914029 A  ERROR'
2019-01-20 20:31:54 [DEBUG   ] Got command BAM from MCS: ref #1231903
2019-01-20 20:31:54 [INFO    ] Finished processing BAM request
2019-01-20 20:31:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231903   8 58503 73914033 A  ERROR'
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:31:54 [DEBUG   ] spawn_process: at 2019-01-20 20:31:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:32:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 20:32:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:32:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 20:32:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:32:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:32:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:32:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 20:32:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:32:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:32:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:32:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:32:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:32:19 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-20 20:32:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 20:32:34 [DEBUG   ] Got command BAM from MCS: ref #1231906
2019-01-20 20:32:34 [INFO    ] Finished processing BAM request
2019-01-20 20:32:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231906   8 58503 73954029 A  ERROR'
2019-01-20 20:32:34 [DEBUG   ] Got command BAM from MCS: ref #1231905
2019-01-20 20:32:34 [INFO    ] Finished processing BAM request
2019-01-20 20:32:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231905   8 58503 73954033 A  ERROR'
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:32:34 [DEBUG   ] spawn_process: at 2019-01-20 20:32:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:32:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 20:33:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 20:33:14 [DEBUG   ] Got command BAM from MCS: ref #1231908
2019-01-20 20:33:14 [INFO    ] Finished processing BAM request
2019-01-20 20:33:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231908   8 58503 73994029 A  ERROR'
2019-01-20 20:33:14 [DEBUG   ] Got command BAM from MCS: ref #1231907
2019-01-20 20:33:14 [INFO    ] Finished processing BAM request
2019-01-20 20:33:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231907   8 58503 73994033 A  ERROR'
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 20:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 20:33:14 [DEBUG   ] spawn_process: at 2019-01-20 20:33:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 20:33:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:33:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 20:33:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 20:33:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:33:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 20:33:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:33:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:33:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:33:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:33:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:33:19 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-01-20 20:33:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 20:33:28 [DEBUG   ] Got command RPT from MCS: ref #1231909
2019-01-20 20:33:28 [DEBUG   ] summary = ERROR
2019-01-20 20:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231909  13 58503 74008053 A  ERRORERROR'
2019-01-20 20:33:28 [DEBUG   ] Got command RPT from MCS: ref #1231910
2019-01-20 20:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231910  77 58503 74008245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:33:28 [DEBUG   ] Got command RPT from MCS: ref #1231911
2019-01-20 20:33:28 [DEBUG   ] summary = ERROR
2019-01-20 20:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231911  13 58503 74008449 A  ERRORERROR'
2019-01-20 20:33:28 [DEBUG   ] Got command RPT from MCS: ref #1231912
2019-01-20 20:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231912  77 58503 74008653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:33:28 [DEBUG   ] Got command RPT from MCS: ref #1231913
2019-01-20 20:33:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 20:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231913  12 58503 74008857 A  ERRORB¢ff'
2019-01-20 20:33:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 20:33:54 [DEBUG   ] Got command BAM from MCS: ref #1231914
2019-01-20 20:33:54 [INFO    ] Finished processing BAM request
2019-01-20 20:33:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231914   8 58503 74034033 A  ERROR'
2019-01-20 20:33:54 [DEBUG   ] Got command BAM from MCS: ref #1231915
2019-01-20 20:33:54 [INFO    ] Finished processing BAM request
2019-01-20 20:33:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231915   8 58503 74034037 A  ERROR'
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:33:54 [DEBUG   ] spawn_process: at 2019-01-20 20:33:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:34:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 20:34:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 20:34:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:34:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:34:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 20:34:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 20:34:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:34:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:34:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:34:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:34:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:34:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:34:19 [DEBUG   ] Finished updating board flags in 1.241 seconds
2019-01-20 20:34:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 20:34:34 [DEBUG   ] Got command BAM from MCS: ref #1231916
2019-01-20 20:34:34 [INFO    ] Finished processing BAM request
2019-01-20 20:34:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231916   8 58503 74074029 A  ERROR'
2019-01-20 20:34:34 [DEBUG   ] Got command BAM from MCS: ref #1231917
2019-01-20 20:34:34 [INFO    ] Finished processing BAM request
2019-01-20 20:34:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231917   8 58503 74074033 A  ERROR'
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:34:34 [DEBUG   ] spawn_process: at 2019-01-20 20:34:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:34:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 20:35:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 20:35:14 [DEBUG   ] Got command BAM from MCS: ref #1231923
2019-01-20 20:35:14 [INFO    ] Finished processing BAM request
2019-01-20 20:35:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:35:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231923   8 58503 74114033 A  ERROR'
2019-01-20 20:35:14 [DEBUG   ] Got command BAM from MCS: ref #1231922
2019-01-20 20:35:14 [INFO    ] Finished processing BAM request
2019-01-20 20:35:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:35:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231922   8 58503 74114037 A  ERROR'
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:35:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:35:14 [DEBUG   ] spawn_process: at 2019-01-20 20:35:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:35:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:35:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:35:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 20:35:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:35:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:35:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:35:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:35:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:35:19 [DEBUG   ] Finished updating board flags in 1.176 seconds
2019-01-20 20:35:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 20:35:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:35:54 [DEBUG   ] Got command BAM from MCS: ref #1231925
2019-01-20 20:35:54 [INFO    ] Finished processing BAM request
2019-01-20 20:35:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231925   8 58503 74154033 A  ERROR'
2019-01-20 20:35:54 [DEBUG   ] Got command BAM from MCS: ref #1231924
2019-01-20 20:35:54 [INFO    ] Finished processing BAM request
2019-01-20 20:35:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231924   8 58503 74154037 A  ERROR'
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:35:54 [DEBUG   ] spawn_process: at 2019-01-20 20:35:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:36:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 20:36:06 [DEBUG   ] Got command RPT from MCS: ref #1231926
2019-01-20 20:36:06 [DEBUG   ] summary = ERROR
2019-01-20 20:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231926  13 58503 74166749 A  ERRORERROR'
2019-01-20 20:36:06 [DEBUG   ] Got command RPT from MCS: ref #1231927
2019-01-20 20:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231927  77 58503 74166750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:36:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:36:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-01-20 20:36:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:36:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:36:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:36:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:36:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:36:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:36:19 [DEBUG   ] Finished updating board flags in 1.033 seconds
2019-01-20 20:36:26 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-20 20:36:34 [DEBUG   ] Got command BAM from MCS: ref #1231943
2019-01-20 20:36:34 [INFO    ] Finished processing BAM request
2019-01-20 20:36:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231943   8 58503 74194029 A  ERROR'
2019-01-20 20:36:34 [DEBUG   ] Got command BAM from MCS: ref #1231944
2019-01-20 20:36:34 [INFO    ] Finished processing BAM request
2019-01-20 20:36:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231944   8 58503 74194033 A  ERROR'
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:36:34 [DEBUG   ] spawn_process: at 2019-01-20 20:36:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:36:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:37:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:37:14 [DEBUG   ] Got command BAM from MCS: ref #1231945
2019-01-20 20:37:14 [INFO    ] Finished processing BAM request
2019-01-20 20:37:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:37:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231945   8 58503 74234029 A  ERROR'
2019-01-20 20:37:14 [DEBUG   ] Got command BAM from MCS: ref #1231946
2019-01-20 20:37:14 [INFO    ] Finished processing BAM request
2019-01-20 20:37:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:37:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231946   8 58503 74234033 A  ERROR'
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:37:14 [DEBUG   ] spawn_process: at 2019-01-20 20:37:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:37:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:37:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:37:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:37:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:37:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:37:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:37:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:37:20 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-01-20 20:37:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:37:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:37:54 [DEBUG   ] Got command BAM from MCS: ref #1231952
2019-01-20 20:37:54 [INFO    ] Finished processing BAM request
2019-01-20 20:37:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:37:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231952   8 58503 74274025 A  ERROR'
2019-01-20 20:37:54 [DEBUG   ] Got command BAM from MCS: ref #1231951
2019-01-20 20:37:54 [INFO    ] Finished processing BAM request
2019-01-20 20:37:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:37:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231951   8 58503 74274029 A  ERROR'
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:37:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:37:54 [DEBUG   ] spawn_process: at 2019-01-20 20:37:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:38:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:38:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2019-01-20 20:38:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:38:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 20:38:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:38:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:38:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:38:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:38:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:38:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:38:19 [DEBUG   ] Finished updating board flags in 1.232 seconds
2019-01-20 20:38:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:38:28 [DEBUG   ] Got command RPT from MCS: ref #1231955
2019-01-20 20:38:28 [DEBUG   ] summary = ERROR
2019-01-20 20:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231955  13 58503 74308129 A  ERRORERROR'
2019-01-20 20:38:28 [DEBUG   ] Got command RPT from MCS: ref #1231956
2019-01-20 20:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231956  77 58503 74308333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:38:28 [DEBUG   ] Got command RPT from MCS: ref #1231957
2019-01-20 20:38:28 [DEBUG   ] summary = ERROR
2019-01-20 20:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231957  13 58503 74308537 A  ERRORERROR'
2019-01-20 20:38:28 [DEBUG   ] Got command RPT from MCS: ref #1231959
2019-01-20 20:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231959  77 58503 74308741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:38:28 [DEBUG   ] Got command RPT from MCS: ref #1231961
2019-01-20 20:38:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 20:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231961  12 58503 74308933 A  ERRORB¢ff'
2019-01-20 20:38:34 [DEBUG   ] Got command BAM from MCS: ref #1231966
2019-01-20 20:38:34 [INFO    ] Finished processing BAM request
2019-01-20 20:38:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231966   8 58503 74314025 A  ERROR'
2019-01-20 20:38:34 [DEBUG   ] Got command BAM from MCS: ref #1231965
2019-01-20 20:38:34 [INFO    ] Finished processing BAM request
2019-01-20 20:38:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231965   8 58503 74314029 A  ERROR'
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:38:34 [DEBUG   ] spawn_process: at 2019-01-20 20:38:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:38:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:39:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:39:14 [DEBUG   ] Got command BAM from MCS: ref #1231967
2019-01-20 20:39:14 [INFO    ] Finished processing BAM request
2019-01-20 20:39:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:39:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231967   8 58503 74354033 A  ERROR'
2019-01-20 20:39:14 [DEBUG   ] Got command BAM from MCS: ref #1231968
2019-01-20 20:39:14 [INFO    ] Finished processing BAM request
2019-01-20 20:39:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:39:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231968   8 58503 74354037 A  ERROR'
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:39:14 [DEBUG   ] spawn_process: at 2019-01-20 20:39:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:39:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:39:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 20:39:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 20:39:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:39:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-20 20:39:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:39:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 20:39:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:39:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:39:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:39:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:39:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:39:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:39:19 [DEBUG   ] Finished updating board flags in 1.221 seconds
2019-01-20 20:39:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:39:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:39:54 [DEBUG   ] Got command BAM from MCS: ref #1231970
2019-01-20 20:39:54 [INFO    ] Finished processing BAM request
2019-01-20 20:39:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231970   8 58503 74394033 A  ERROR'
2019-01-20 20:39:54 [DEBUG   ] Got command BAM from MCS: ref #1231969
2019-01-20 20:39:54 [INFO    ] Finished processing BAM request
2019-01-20 20:39:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231969   8 58503 74394037 A  ERROR'
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:39:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:39:54 [DEBUG   ] spawn_process: at 2019-01-20 20:39:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:40:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:40:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 20:40:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:40:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:40:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:40:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:40:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:40:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:40:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:40:19 [DEBUG   ] Finished updating board flags in 1.185 seconds
2019-01-20 20:40:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:40:34 [DEBUG   ] Got command BAM from MCS: ref #1231971
2019-01-20 20:40:34 [INFO    ] Finished processing BAM request
2019-01-20 20:40:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:40:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231971   8 58503 74434025 A  ERROR'
2019-01-20 20:40:34 [DEBUG   ] Got command BAM from MCS: ref #1231972
2019-01-20 20:40:34 [INFO    ] Finished processing BAM request
2019-01-20 20:40:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:40:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231972   8 58503 74434029 A  ERROR'
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:40:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:40:34 [DEBUG   ] spawn_process: at 2019-01-20 20:40:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:40:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:41:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:41:06 [DEBUG   ] Got command RPT from MCS: ref #1231977
2019-01-20 20:41:06 [DEBUG   ] summary = ERROR
2019-01-20 20:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231977  13 58503 74466757 A  ERRORERROR'
2019-01-20 20:41:06 [DEBUG   ] Got command RPT from MCS: ref #1231978
2019-01-20 20:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1231978  77 58503 74466758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:41:14 [DEBUG   ] Got command BAM from MCS: ref #1231994
2019-01-20 20:41:14 [INFO    ] Finished processing BAM request
2019-01-20 20:41:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:41:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231994   8 58503 74474025 A  ERROR'
2019-01-20 20:41:14 [DEBUG   ] Got command BAM from MCS: ref #1231995
2019-01-20 20:41:14 [INFO    ] Finished processing BAM request
2019-01-20 20:41:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:41:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231995   8 58503 74474029 A  ERROR'
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:41:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:41:14 [DEBUG   ] spawn_process: at 2019-01-20 20:41:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:41:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:41:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:41:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 20:41:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:41:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:41:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:41:19 [WARNING ] (13, 1, 'bot')
2019-01-20 20:41:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:41:19 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-01-20 20:41:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:41:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:41:54 [DEBUG   ] Got command BAM from MCS: ref #1231996
2019-01-20 20:41:54 [INFO    ] Finished processing BAM request
2019-01-20 20:41:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231996   8 58503 74514025 A  ERROR'
2019-01-20 20:41:54 [DEBUG   ] Got command BAM from MCS: ref #1231997
2019-01-20 20:41:54 [INFO    ] Finished processing BAM request
2019-01-20 20:41:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231997   8 58503 74514029 A  ERROR'
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 20:41:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 20:41:54 [DEBUG   ] spawn_process: at 2019-01-20 20:41:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 20:42:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:42:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:42:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:42:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:42:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:42:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:42:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:42:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:42:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:42:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:42:20 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-20 20:42:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:42:34 [DEBUG   ] Got command BAM from MCS: ref #1231998
2019-01-20 20:42:34 [INFO    ] Finished processing BAM request
2019-01-20 20:42:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231998   8 58503 74554033 A  ERROR'
2019-01-20 20:42:34 [DEBUG   ] Got command BAM from MCS: ref #1231999
2019-01-20 20:42:34 [INFO    ] Finished processing BAM request
2019-01-20 20:42:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1231999   8 58503 74554037 A  ERROR'
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:42:34 [DEBUG   ] spawn_process: at 2019-01-20 20:42:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:42:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:43:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:43:14 [DEBUG   ] Got command BAM from MCS: ref #1232000
2019-01-20 20:43:14 [INFO    ] Finished processing BAM request
2019-01-20 20:43:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232000   8 58503 74594029 A  ERROR'
2019-01-20 20:43:14 [DEBUG   ] Got command BAM from MCS: ref #1232001
2019-01-20 20:43:14 [INFO    ] Finished processing BAM request
2019-01-20 20:43:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232001   8 58503 74594033 A  ERROR'
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:43:14 [DEBUG   ] spawn_process: at 2019-01-20 20:43:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:43:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 20:43:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:43:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:43:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 20:43:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:43:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 20:43:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:43:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:43:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:43:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:43:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:43:20 [DEBUG   ] Finished updating board flags in 1.347 seconds
2019-01-20 20:43:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:43:28 [DEBUG   ] Got command RPT from MCS: ref #1232002
2019-01-20 20:43:28 [DEBUG   ] summary = ERROR
2019-01-20 20:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232002  13 58503 74608225 A  ERRORERROR'
2019-01-20 20:43:28 [DEBUG   ] Got command RPT from MCS: ref #1232003
2019-01-20 20:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232003  77 58503 74608417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:43:28 [DEBUG   ] Got command RPT from MCS: ref #1232004
2019-01-20 20:43:28 [DEBUG   ] summary = ERROR
2019-01-20 20:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232004  13 58503 74608621 A  ERRORERROR'
2019-01-20 20:43:28 [DEBUG   ] Got command RPT from MCS: ref #1232005
2019-01-20 20:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232005  77 58503 74608825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:43:29 [DEBUG   ] Got command RPT from MCS: ref #1232006
2019-01-20 20:43:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 20:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232006  12 58503 74609029 A  ERRORB£ff'
2019-01-20 20:43:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:43:54 [DEBUG   ] Got command BAM from MCS: ref #1232011
2019-01-20 20:43:54 [INFO    ] Finished processing BAM request
2019-01-20 20:43:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232011   8 58503 74634029 A  ERROR'
2019-01-20 20:43:54 [DEBUG   ] Got command BAM from MCS: ref #1232012
2019-01-20 20:43:54 [INFO    ] Finished processing BAM request
2019-01-20 20:43:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232012   8 58503 74634033 A  ERROR'
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:43:54 [DEBUG   ] spawn_process: at 2019-01-20 20:43:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:44:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:44:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:44:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 20:44:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:44:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:44:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:44:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:44:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:44:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:44:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:44:20 [DEBUG   ] Finished updating board flags in 1.218 seconds
2019-01-20 20:44:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:44:34 [DEBUG   ] Got command BAM from MCS: ref #1232013
2019-01-20 20:44:34 [INFO    ] Finished processing BAM request
2019-01-20 20:44:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:44:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232013   8 58503 74674025 A  ERROR'
2019-01-20 20:44:34 [DEBUG   ] Got command BAM from MCS: ref #1232014
2019-01-20 20:44:34 [INFO    ] Finished processing BAM request
2019-01-20 20:44:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:44:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232014   8 58503 74674029 A  ERROR'
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:44:34 [DEBUG   ] spawn_process: at 2019-01-20 20:44:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:44:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:45:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:45:14 [DEBUG   ] Got command BAM from MCS: ref #1232016
2019-01-20 20:45:14 [INFO    ] Finished processing BAM request
2019-01-20 20:45:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232016   8 58503 74714029 A  ERROR'
2019-01-20 20:45:14 [DEBUG   ] Got command BAM from MCS: ref #1232015
2019-01-20 20:45:14 [INFO    ] Finished processing BAM request
2019-01-20 20:45:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232015   8 58503 74714033 A  ERROR'
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:45:14 [DEBUG   ] spawn_process: at 2019-01-20 20:45:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:45:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:45:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 20:45:20 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:45:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 20:45:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:45:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:45:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:45:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:45:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:45:20 [DEBUG   ] Finished updating board flags in 1.166 seconds
2019-01-20 20:45:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:45:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:45:54 [DEBUG   ] Got command BAM from MCS: ref #1232018
2019-01-20 20:45:54 [INFO    ] Finished processing BAM request
2019-01-20 20:45:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232018   8 58503 74754029 A  ERROR'
2019-01-20 20:45:54 [DEBUG   ] Got command BAM from MCS: ref #1232017
2019-01-20 20:45:54 [INFO    ] Finished processing BAM request
2019-01-20 20:45:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232017   8 58503 74754033 A  ERROR'
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:45:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:45:54 [DEBUG   ] spawn_process: at 2019-01-20 20:45:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:46:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:46:06 [DEBUG   ] Got command RPT from MCS: ref #1232019
2019-01-20 20:46:06 [DEBUG   ] summary = ERROR
2019-01-20 20:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232019  13 58503 74766753 A  ERRORERROR'
2019-01-20 20:46:06 [DEBUG   ] Got command RPT from MCS: ref #1232020
2019-01-20 20:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232020  77 58503 74766754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:46:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:46:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:46:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:46:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:46:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:46:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:46:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:46:20 [DEBUG   ] Finished updating board flags in 1.020 seconds
2019-01-20 20:46:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:46:34 [DEBUG   ] Got command BAM from MCS: ref #1232036
2019-01-20 20:46:34 [INFO    ] Finished processing BAM request
2019-01-20 20:46:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:46:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232036   8 58503 74794033 A  ERROR'
2019-01-20 20:46:34 [DEBUG   ] Got command BAM from MCS: ref #1232037
2019-01-20 20:46:34 [INFO    ] Finished processing BAM request
2019-01-20 20:46:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:46:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232037   8 58503 74794037 A  ERROR'
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:46:34 [DEBUG   ] spawn_process: at 2019-01-20 20:46:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:46:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 20:47:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 20:47:14 [DEBUG   ] Got command BAM from MCS: ref #1232043
2019-01-20 20:47:14 [INFO    ] Finished processing BAM request
2019-01-20 20:47:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:47:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232043   8 58503 74834025 A  ERROR'
2019-01-20 20:47:14 [DEBUG   ] Got command BAM from MCS: ref #1232042
2019-01-20 20:47:14 [INFO    ] Finished processing BAM request
2019-01-20 20:47:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:47:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232042   8 58503 74834029 A  ERROR'
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:47:14 [DEBUG   ] spawn_process: at 2019-01-20 20:47:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:47:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:47:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:47:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:47:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:47:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:47:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:47:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:47:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:47:20 [DEBUG   ] Finished updating board flags in 0.990 seconds
2019-01-20 20:47:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 20:47:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 20:47:54 [DEBUG   ] Got command BAM from MCS: ref #1232045
2019-01-20 20:47:54 [INFO    ] Finished processing BAM request
2019-01-20 20:47:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:47:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232045   8 58503 74874025 A  ERROR'
2019-01-20 20:47:54 [DEBUG   ] Got command BAM from MCS: ref #1232044
2019-01-20 20:47:54 [INFO    ] Finished processing BAM request
2019-01-20 20:47:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:47:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232044   8 58503 74874029 A  ERROR'
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 20:47:54 [DEBUG   ] spawn_process: at 2019-01-20 20:47:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 20:48:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 20:48:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:48:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 20:48:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:48:21 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:48:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 20:48:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:48:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:48:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:48:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:48:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:48:21 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-20 20:48:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 20:48:28 [DEBUG   ] Got command RPT from MCS: ref #1232048
2019-01-20 20:48:28 [DEBUG   ] summary = ERROR
2019-01-20 20:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232048  13 58503 74908309 A  ERRORERROR'
2019-01-20 20:48:28 [DEBUG   ] Got command RPT from MCS: ref #1232049
2019-01-20 20:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232049  77 58503 74908513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:48:28 [DEBUG   ] Got command RPT from MCS: ref #1232050
2019-01-20 20:48:28 [DEBUG   ] summary = ERROR
2019-01-20 20:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232050  13 58503 74908713 A  ERRORERROR'
2019-01-20 20:48:28 [DEBUG   ] Got command RPT from MCS: ref #1232052
2019-01-20 20:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232052  77 58503 74908905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:48:29 [DEBUG   ] Got command RPT from MCS: ref #1232054
2019-01-20 20:48:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 20:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232054  12 58503 74909109 A  ERRORB£ff'
2019-01-20 20:48:35 [DEBUG   ] Got command BAM from MCS: ref #1232059
2019-01-20 20:48:35 [INFO    ] Finished processing BAM request
2019-01-20 20:48:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232059   8 58503 74915029 A  ERROR'
2019-01-20 20:48:35 [DEBUG   ] Got command BAM from MCS: ref #1232058
2019-01-20 20:48:35 [INFO    ] Finished processing BAM request
2019-01-20 20:48:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232058   8 58503 74915033 A  ERROR'
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:48:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:48:35 [DEBUG   ] spawn_process: at 2019-01-20 20:48:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:48:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 20:49:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 20:49:16 [DEBUG   ] Got command BAM from MCS: ref #1232060
2019-01-20 20:49:16 [INFO    ] Finished processing BAM request
2019-01-20 20:49:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232060   8 58503 74956029 A  ERROR'
2019-01-20 20:49:16 [DEBUG   ] Got command BAM from MCS: ref #1232061
2019-01-20 20:49:16 [INFO    ] Finished processing BAM request
2019-01-20 20:49:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232061   8 58503 74956033 A  ERROR'
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:49:16 [DEBUG   ] spawn_process: at 2019-01-20 20:49:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:49:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:49:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 20:49:20 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:49:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:49:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:49:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:49:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:49:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:49:20 [DEBUG   ] Finished updating board flags in 1.225 seconds
2019-01-20 20:49:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 20:49:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 20:49:57 [DEBUG   ] Got command BAM from MCS: ref #1232067
2019-01-20 20:49:57 [INFO    ] Finished processing BAM request
2019-01-20 20:49:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232067   8 58503 74997029 A  ERROR'
2019-01-20 20:49:57 [DEBUG   ] Got command BAM from MCS: ref #1232066
2019-01-20 20:49:57 [INFO    ] Finished processing BAM request
2019-01-20 20:49:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232066   8 58503 74997033 A  ERROR'
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:49:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:49:57 [DEBUG   ] spawn_process: at 2019-01-20 20:49:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:50:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 20:50:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-20 20:50:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:50:21 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:50:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:50:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:50:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:50:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:50:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:50:21 [DEBUG   ] Finished updating board flags in 1.844 seconds
2019-01-20 20:50:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 20:50:38 [DEBUG   ] Got command BAM from MCS: ref #1232068
2019-01-20 20:50:38 [INFO    ] Finished processing BAM request
2019-01-20 20:50:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:50:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232068   8 58503 75038033 A  ERROR'
2019-01-20 20:50:38 [DEBUG   ] Got command BAM from MCS: ref #1232069
2019-01-20 20:50:38 [INFO    ] Finished processing BAM request
2019-01-20 20:50:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:50:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232069   8 58503 75038037 A  ERROR'
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:50:38 [DEBUG   ] spawn_process: at 2019-01-20 20:50:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:50:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 20:51:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 20:51:06 [DEBUG   ] Got command RPT from MCS: ref #1232070
2019-01-20 20:51:06 [DEBUG   ] summary = ERROR
2019-01-20 20:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232070  13 58503 75066766 A  ERRORERROR'
2019-01-20 20:51:06 [DEBUG   ] Got command RPT from MCS: ref #1232071
2019-01-20 20:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232071  77 58503 75066766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:51:19 [DEBUG   ] Got command BAM from MCS: ref #1232087
2019-01-20 20:51:19 [INFO    ] Finished processing BAM request
2019-01-20 20:51:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:51:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232087   8 58503 75079033 A  ERROR'
2019-01-20 20:51:19 [DEBUG   ] Got command BAM from MCS: ref #1232088
2019-01-20 20:51:19 [INFO    ] Finished processing BAM request
2019-01-20 20:51:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:51:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232088   8 58503 75079037 A  ERROR'
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:51:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:51:19 [DEBUG   ] spawn_process: at 2019-01-20 20:51:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:51:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-20 20:51:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:51:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-20 20:51:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:51:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:51:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:51:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:51:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:51:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:51:20 [DEBUG   ] Finished updating board flags in 1.171 seconds
2019-01-20 20:51:26 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-20 20:51:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:52:00 [DEBUG   ] Got command BAM from MCS: ref #1232090
2019-01-20 20:52:00 [INFO    ] Finished processing BAM request
2019-01-20 20:52:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232090   8 58503 75120033 A  ERROR'
2019-01-20 20:52:00 [DEBUG   ] Got command BAM from MCS: ref #1232089
2019-01-20 20:52:00 [INFO    ] Finished processing BAM request
2019-01-20 20:52:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232089   8 58503 75120037 A  ERROR'
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:52:00 [DEBUG   ] spawn_process: at 2019-01-20 20:52:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:52:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:52:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:52:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:52:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 20:52:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:52:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:52:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:52:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:52:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:52:20 [DEBUG   ] Finished updating board flags in 1.026 seconds
2019-01-20 20:52:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:52:41 [DEBUG   ] Got command BAM from MCS: ref #1232095
2019-01-20 20:52:41 [INFO    ] Finished processing BAM request
2019-01-20 20:52:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232095   8 58503 75161025 A  ERROR'
2019-01-20 20:52:41 [DEBUG   ] Got command BAM from MCS: ref #1232096
2019-01-20 20:52:41 [INFO    ] Finished processing BAM request
2019-01-20 20:52:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232096   8 58503 75161029 A  ERROR'
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:52:41 [DEBUG   ] spawn_process: at 2019-01-20 20:52:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:52:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 20:53:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 20:53:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:53:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:53:20 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:53:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:53:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:53:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:53:20 [WARNING ] (13, 1, 'bot')
2019-01-20 20:53:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:53:20 [DEBUG   ] Finished updating board flags in 0.981 seconds
2019-01-20 20:53:22 [DEBUG   ] Got command BAM from MCS: ref #1232098
2019-01-20 20:53:22 [INFO    ] Finished processing BAM request
2019-01-20 20:53:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232098   8 58503 75202033 A  ERROR'
2019-01-20 20:53:22 [DEBUG   ] Got command BAM from MCS: ref #1232097
2019-01-20 20:53:22 [INFO    ] Finished processing BAM request
2019-01-20 20:53:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232097   8 58503 75202037 A  ERROR'
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:53:22 [DEBUG   ] spawn_process: at 2019-01-20 20:53:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:53:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 20:53:28 [DEBUG   ] Got command RPT from MCS: ref #1232099
2019-01-20 20:53:28 [DEBUG   ] summary = ERROR
2019-01-20 20:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232099  13 58503 75208389 A  ERRORERROR'
2019-01-20 20:53:28 [DEBUG   ] Got command RPT from MCS: ref #1232100
2019-01-20 20:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232100  77 58503 75208593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:53:28 [DEBUG   ] Got command RPT from MCS: ref #1232101
2019-01-20 20:53:28 [DEBUG   ] summary = ERROR
2019-01-20 20:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232101  13 58503 75208797 A  ERRORERROR'
2019-01-20 20:53:28 [DEBUG   ] Got command RPT from MCS: ref #1232102
2019-01-20 20:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232102  77 58503 75208989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:53:29 [DEBUG   ] Got command RPT from MCS: ref #1232103
2019-01-20 20:53:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 20:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232103  12 58503 75209193 A  ERRORB¢ff'
2019-01-20 20:53:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 20:54:03 [DEBUG   ] Got command BAM from MCS: ref #1232104
2019-01-20 20:54:03 [INFO    ] Finished processing BAM request
2019-01-20 20:54:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232104   8 58503 75243029 A  ERROR'
2019-01-20 20:54:03 [DEBUG   ] Got command BAM from MCS: ref #1232105
2019-01-20 20:54:03 [INFO    ] Finished processing BAM request
2019-01-20 20:54:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232105   8 58503 75243033 A  ERROR'
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:54:03 [DEBUG   ] spawn_process: at 2019-01-20 20:54:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:54:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 20:54:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:54:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 20:54:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:54:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:54:21 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:54:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 20:54:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:54:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:54:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:54:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:54:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:54:21 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-01-20 20:54:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:54:44 [DEBUG   ] Got command BAM from MCS: ref #1232106
2019-01-20 20:54:44 [INFO    ] Finished processing BAM request
2019-01-20 20:54:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232106   8 58503 75284029 A  ERROR'
2019-01-20 20:54:44 [DEBUG   ] Got command BAM from MCS: ref #1232107
2019-01-20 20:54:44 [INFO    ] Finished processing BAM request
2019-01-20 20:54:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232107   8 58503 75284033 A  ERROR'
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:54:44 [DEBUG   ] spawn_process: at 2019-01-20 20:54:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:54:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:55:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:55:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-20 20:55:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:55:21 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:55:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 20:55:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:55:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:55:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:55:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:55:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:55:21 [DEBUG   ] Finished updating board flags in 1.190 seconds
2019-01-20 20:55:25 [DEBUG   ] Got command BAM from MCS: ref #1232109
2019-01-20 20:55:25 [INFO    ] Finished processing BAM request
2019-01-20 20:55:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:55:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232109   8 58503 75325029 A  ERROR'
2019-01-20 20:55:25 [DEBUG   ] Got command BAM from MCS: ref #1232108
2019-01-20 20:55:25 [INFO    ] Finished processing BAM request
2019-01-20 20:55:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:55:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232108   8 58503 75325033 A  ERROR'
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 20:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 20:55:25 [DEBUG   ] spawn_process: at 2019-01-20 20:55:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 20:55:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:55:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:56:06 [DEBUG   ] Got command BAM from MCS: ref #1232115
2019-01-20 20:56:06 [INFO    ] Finished processing BAM request
2019-01-20 20:56:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232115   8 58503 75366033 A  ERROR'
2019-01-20 20:56:06 [DEBUG   ] Got command BAM from MCS: ref #1232114
2019-01-20 20:56:06 [INFO    ] Finished processing BAM request
2019-01-20 20:56:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232114   8 58503 75366037 A  ERROR'
2019-01-20 20:56:06 [DEBUG   ] Got command RPT from MCS: ref #1232116
2019-01-20 20:56:06 [DEBUG   ] summary = ERROR
2019-01-20 20:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232116  13 58503 75366757 A  ERRORERROR'
2019-01-20 20:56:06 [DEBUG   ] Got command RPT from MCS: ref #1232117
2019-01-20 20:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232117  77 58503 75366758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:56:06 [DEBUG   ] spawn_process: at 2019-01-20 20:56:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:56:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:56:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 20:56:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:56:21 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-20 20:56:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 20:56:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:56:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:56:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:56:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:56:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:56:21 [DEBUG   ] Finished updating board flags in 1.006 seconds
2019-01-20 20:56:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 20:56:47 [DEBUG   ] Got command BAM from MCS: ref #1232133
2019-01-20 20:56:47 [INFO    ] Finished processing BAM request
2019-01-20 20:56:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:56:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232133   8 58503 75407033 A  ERROR'
2019-01-20 20:56:47 [DEBUG   ] Got command BAM from MCS: ref #1232134
2019-01-20 20:56:47 [INFO    ] Finished processing BAM request
2019-01-20 20:56:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:56:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232134   8 58503 75407037 A  ERROR'
2019-01-20 20:56:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 20:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 20:56:47 [DEBUG   ] spawn_process: at 2019-01-20 20:56:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 20:57:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:57:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:57:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:57:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 20:57:21 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:57:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-20 20:57:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:57:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:57:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:57:21 [WARNING ] (13, 1, 'bot')
2019-01-20 20:57:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:57:21 [DEBUG   ] Finished updating board flags in 1.070 seconds
2019-01-20 20:57:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 20:57:28 [DEBUG   ] Got command BAM from MCS: ref #1232136
2019-01-20 20:57:28 [INFO    ] Finished processing BAM request
2019-01-20 20:57:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232136   8 58503 75448025 A  ERROR'
2019-01-20 20:57:28 [DEBUG   ] Got command BAM from MCS: ref #1232135
2019-01-20 20:57:28 [INFO    ] Finished processing BAM request
2019-01-20 20:57:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232135   8 58503 75448029 A  ERROR'
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-20 20:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-20 20:57:28 [DEBUG   ] spawn_process: at 2019-01-20 20:57:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-20 20:57:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 20:58:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:58:09 [DEBUG   ] Got command BAM from MCS: ref #1232137
2019-01-20 20:58:09 [INFO    ] Finished processing BAM request
2019-01-20 20:58:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232137   8 58503 75489025 A  ERROR'
2019-01-20 20:58:09 [DEBUG   ] Got command BAM from MCS: ref #1232138
2019-01-20 20:58:09 [INFO    ] Finished processing BAM request
2019-01-20 20:58:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232138   8 58503 75489029 A  ERROR'
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-20 20:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-20 20:58:09 [DEBUG   ] spawn_process: at 2019-01-20 20:58:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-20 20:58:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 20:58:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:58:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:58:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-20 20:58:22 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:58:22 [WARNING ] (13, 1, 'bot')
2019-01-20 20:58:22 [WARNING ] (13, 1, 'bot')
2019-01-20 20:58:22 [WARNING ] (13, 1, 'bot')
2019-01-20 20:58:22 [WARNING ] (13, 1, 'bot')
2019-01-20 20:58:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:58:22 [DEBUG   ] Finished updating board flags in 2.001 seconds
2019-01-20 20:58:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:58:28 [DEBUG   ] Got command RPT from MCS: ref #1232141
2019-01-20 20:58:28 [DEBUG   ] summary = ERROR
2019-01-20 20:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232141  13 58503 75508473 A  ERRORERROR'
2019-01-20 20:58:28 [DEBUG   ] Got command RPT from MCS: ref #1232142
2019-01-20 20:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232142  77 58503 75508677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:58:28 [DEBUG   ] Got command RPT from MCS: ref #1232143
2019-01-20 20:58:28 [DEBUG   ] summary = ERROR
2019-01-20 20:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232143  13 58503 75508881 A  ERRORERROR'
2019-01-20 20:58:29 [DEBUG   ] Got command RPT from MCS: ref #1232145
2019-01-20 20:58:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 20:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232145  77 58503 75509073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 20:58:29 [DEBUG   ] Got command RPT from MCS: ref #1232146
2019-01-20 20:58:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 20:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232146  12 58503 75509277 A  ERRORB£ff'
2019-01-20 20:58:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 20:58:50 [DEBUG   ] Got command BAM from MCS: ref #1232156
2019-01-20 20:58:50 [INFO    ] Finished processing BAM request
2019-01-20 20:58:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:58:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232156   8 58503 75530025 A  ERROR'
2019-01-20 20:58:50 [DEBUG   ] Got command BAM from MCS: ref #1232155
2019-01-20 20:58:50 [INFO    ] Finished processing BAM request
2019-01-20 20:58:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:58:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232155   8 58503 75530029 A  ERROR'
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:58:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:58:50 [DEBUG   ] spawn_process: at 2019-01-20 20:58:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:59:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:59:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2019-01-20 20:59:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 20:59:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 20:59:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-20 20:59:22 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 20:59:22 [WARNING ] (13, 1, 'bot')
2019-01-20 20:59:22 [WARNING ] (13, 1, 'bot')
2019-01-20 20:59:22 [WARNING ] (13, 1, 'bot')
2019-01-20 20:59:22 [WARNING ] (13, 1, 'bot')
2019-01-20 20:59:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 20:59:22 [DEBUG   ] Finished updating board flags in 1.953 seconds
2019-01-20 20:59:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 20:59:31 [DEBUG   ] Got command BAM from MCS: ref #1232157
2019-01-20 20:59:31 [INFO    ] Finished processing BAM request
2019-01-20 20:59:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:59:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232157   8 58503 75571033 A  ERROR'
2019-01-20 20:59:31 [DEBUG   ] Got command BAM from MCS: ref #1232158
2019-01-20 20:59:31 [INFO    ] Finished processing BAM request
2019-01-20 20:59:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 20:59:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232158   8 58503 75571037 A  ERROR'
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-20 20:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-20 20:59:31 [DEBUG   ] spawn_process: at 2019-01-20 20:59:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-20 20:59:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 21:00:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 21:00:12 [DEBUG   ] Got command BAM from MCS: ref #1232159
2019-01-20 21:00:12 [INFO    ] Finished processing BAM request
2019-01-20 21:00:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 21:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232159   8 58503 75612033 A  ERROR'
2019-01-20 21:00:12 [DEBUG   ] Got command BAM from MCS: ref #1232160
2019-01-20 21:00:12 [INFO    ] Finished processing BAM request
2019-01-20 21:00:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-20 21:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1232160   8 58503 75612037 A  ERROR'
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-20 21:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-20 21:00:12 [DEBUG   ] spawn_process: at 2019-01-20 21:00:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-20 21:00:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:00:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-20 21:00:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:00:21 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-20 21:00:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:00:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:00:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:00:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:00:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:00:21 [DEBUG   ] Finished updating board flags in 1.228 seconds
2019-01-20 21:00:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 21:00:30 [DEBUG   ] Got command STP from MCS: ref #1232161
2019-01-20 21:00:30 [INFO    ] Finished processing BAM request
2019-01-20 21:00:30 [INFO    ] Shutdown the adder chain on beam #2
2019-01-20 21:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1232161   8 58503 75630029 A  ERROR'
2019-01-20 21:00:30 [DEBUG   ] Got command STP from MCS: ref #1232162
2019-01-20 21:00:30 [INFO    ] Finished processing BAM request
2019-01-20 21:00:30 [INFO    ] Shutdown the adder chain on beam #4
2019-01-20 21:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1232162   8 58503 75630033 A  ERROR'
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-20 21:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-20 21:00:30 [DEBUG   ] spawn_process: at 2019-01-20 21:00:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-20 21:00:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 21:01:06 [DEBUG   ] Got command RPT from MCS: ref #1232163
2019-01-20 21:01:06 [DEBUG   ] summary = ERROR
2019-01-20 21:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232163  13 58503 75666765 A  ERRORERROR'
2019-01-20 21:01:06 [DEBUG   ] Got command RPT from MCS: ref #1232164
2019-01-20 21:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232164  77 58503 75666766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:01:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 21:01:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:01:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:01:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:01:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:01:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:01:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:01:21 [DEBUG   ] Finished updating board flags in 1.218 seconds
2019-01-20 21:01:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 21:01:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 21:02:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 21:02:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:02:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:02:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-20 21:02:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:02:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:02:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:02:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:02:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:02:21 [DEBUG   ] Finished updating board flags in 1.221 seconds
2019-01-20 21:02:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 21:02:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 21:03:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 21:03:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:03:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 21:03:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:03:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:03:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:03:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:03:21 [WARNING ] (13, 1, 'bot')
2019-01-20 21:03:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:03:21 [DEBUG   ] Finished updating board flags in 1.167 seconds
2019-01-20 21:03:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 21:03:28 [DEBUG   ] Got command RPT from MCS: ref #1232184
2019-01-20 21:03:28 [DEBUG   ] summary = ERROR
2019-01-20 21:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232184  13 58503 75808553 A  ERRORERROR'
2019-01-20 21:03:28 [DEBUG   ] Got command RPT from MCS: ref #1232185
2019-01-20 21:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232185  77 58503 75808757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:03:28 [DEBUG   ] Got command RPT from MCS: ref #1232186
2019-01-20 21:03:28 [DEBUG   ] summary = ERROR
2019-01-20 21:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232186  13 58503 75808961 A  ERRORERROR'
2019-01-20 21:03:29 [DEBUG   ] Got command RPT from MCS: ref #1232187
2019-01-20 21:03:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232187  77 58503 75809165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:03:29 [DEBUG   ] Got command RPT from MCS: ref #1232188
2019-01-20 21:03:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 21:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232188  12 58503 75809357 A  ERRORB›™š'
2019-01-20 21:03:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 21:04:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 21:04:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:04:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:04:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:04:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:04:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:04:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:04:22 [DEBUG   ] Finished updating board flags in 1.568 seconds
2019-01-20 21:04:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 21:04:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 21:05:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 21:05:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:05:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 21:05:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:05:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:05:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:05:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:05:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:05:22 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-01-20 21:05:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 21:05:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 21:06:06 [DEBUG   ] Got command RPT from MCS: ref #1232193
2019-01-20 21:06:06 [DEBUG   ] summary = ERROR
2019-01-20 21:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232193  13 58503 75966765 A  ERRORERROR'
2019-01-20 21:06:06 [DEBUG   ] Got command RPT from MCS: ref #1232194
2019-01-20 21:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232194  77 58503 75966766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:06:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 21:06:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:06:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:06:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:06:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:06:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:06:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:06:22 [DEBUG   ] Finished updating board flags in 1.264 seconds
2019-01-20 21:06:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 21:06:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 21:07:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 21:07:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:07:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:07:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:07:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:07:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:07:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:07:22 [DEBUG   ] Finished updating board flags in 1.157 seconds
2019-01-20 21:07:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 21:07:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 21:08:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 21:08:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:08:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:08:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:08:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:08:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:08:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:08:22 [DEBUG   ] Finished updating board flags in 1.021 seconds
2019-01-20 21:08:27 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2019-01-20 21:08:28 [DEBUG   ] Got command RPT from MCS: ref #1232216
2019-01-20 21:08:28 [DEBUG   ] summary = ERROR
2019-01-20 21:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232216  13 58503 76108637 A  ERRORERROR'
2019-01-20 21:08:28 [DEBUG   ] Got command RPT from MCS: ref #1232217
2019-01-20 21:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232217  77 58503 76108841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:08:29 [DEBUG   ] Got command RPT from MCS: ref #1232218
2019-01-20 21:08:29 [DEBUG   ] summary = ERROR
2019-01-20 21:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232218  13 58503 76109034 A  ERRORERROR'
2019-01-20 21:08:29 [DEBUG   ] Got command RPT from MCS: ref #1232220
2019-01-20 21:08:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232220  77 58503 76109237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:08:29 [DEBUG   ] Got command RPT from MCS: ref #1232222
2019-01-20 21:08:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 21:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232222  12 58503 76109441 A  ERRORB™™š'
2019-01-20 21:08:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:09:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:09:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:09:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:09:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:09:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:09:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:09:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:09:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:09:23 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-20 21:09:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:09:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 21:10:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:10:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:10:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:10:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:10:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:10:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:10:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:10:23 [DEBUG   ] Finished updating board flags in 1.966 seconds
2019-01-20 21:10:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:10:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:11:06 [DEBUG   ] Got command RPT from MCS: ref #1232230
2019-01-20 21:11:06 [DEBUG   ] summary = ERROR
2019-01-20 21:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232230  13 58503 76266761 A  ERRORERROR'
2019-01-20 21:11:06 [DEBUG   ] Got command RPT from MCS: ref #1232231
2019-01-20 21:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232231  77 58503 76266762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:11:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:11:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:11:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:11:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:11:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:11:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:11:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:11:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:11:22 [DEBUG   ] Finished updating board flags in 1.248 seconds
2019-01-20 21:11:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:11:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:12:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:12:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:12:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 21:12:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:12:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:12:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:12:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:12:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:12:22 [DEBUG   ] Finished updating board flags in 1.220 seconds
2019-01-20 21:12:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:12:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:13:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:13:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:13:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:13:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:13:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:13:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:13:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:13:22 [DEBUG   ] Finished updating board flags in 1.238 seconds
2019-01-20 21:13:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:13:28 [DEBUG   ] Got command RPT from MCS: ref #1232247
2019-01-20 21:13:28 [DEBUG   ] summary = ERROR
2019-01-20 21:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232247  13 58503 76408717 A  ERRORERROR'
2019-01-20 21:13:28 [DEBUG   ] Got command RPT from MCS: ref #1232248
2019-01-20 21:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232248  77 58503 76408921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:13:29 [DEBUG   ] Got command RPT from MCS: ref #1232249
2019-01-20 21:13:29 [DEBUG   ] summary = ERROR
2019-01-20 21:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232249  13 58503 76409113 A  ERRORERROR'
2019-01-20 21:13:29 [DEBUG   ] Got command RPT from MCS: ref #1232250
2019-01-20 21:13:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232250  77 58503 76409317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:13:29 [DEBUG   ] Got command RPT from MCS: ref #1232251
2019-01-20 21:13:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 21:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232251  12 58503 76409521 A  ERRORB˜™š'
2019-01-20 21:13:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 21:14:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:14:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:14:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:14:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:14:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:14:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:14:22 [WARNING ] (13, 1, 'bot')
2019-01-20 21:14:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:14:22 [DEBUG   ] Finished updating board flags in 1.178 seconds
2019-01-20 21:14:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:14:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:15:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:15:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:15:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:15:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:15:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:15:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:15:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:15:23 [DEBUG   ] Finished updating board flags in 1.577 seconds
2019-01-20 21:15:28 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-20 21:15:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 21:16:06 [DEBUG   ] Got command RPT from MCS: ref #1232256
2019-01-20 21:16:06 [DEBUG   ] summary = ERROR
2019-01-20 21:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232256  13 58503 76566765 A  ERRORERROR'
2019-01-20 21:16:06 [DEBUG   ] Got command RPT from MCS: ref #1232257
2019-01-20 21:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232257  77 58503 76566766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:16:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 21:16:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:16:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:16:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:16:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:16:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:16:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:16:23 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-20 21:16:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 21:16:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 21:17:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 21:17:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:17:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:17:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:17:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:17:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:17:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:17:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:17:23 [DEBUG   ] Finished updating board flags in 1.344 seconds
2019-01-20 21:17:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 21:17:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 21:18:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 21:18:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:18:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:18:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:18:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:18:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:18:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:18:23 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-01-20 21:18:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 21:18:28 [DEBUG   ] Got command RPT from MCS: ref #1232279
2019-01-20 21:18:28 [DEBUG   ] summary = ERROR
2019-01-20 21:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232279  13 58503 76708797 A  ERRORERROR'
2019-01-20 21:18:29 [DEBUG   ] Got command RPT from MCS: ref #1232280
2019-01-20 21:18:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232280  77 58503 76709001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:18:29 [DEBUG   ] Got command RPT from MCS: ref #1232281
2019-01-20 21:18:29 [DEBUG   ] summary = ERROR
2019-01-20 21:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232281  13 58503 76709193 A  ERRORERROR'
2019-01-20 21:18:29 [DEBUG   ] Got command RPT from MCS: ref #1232283
2019-01-20 21:18:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232283  77 58503 76709397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:18:29 [DEBUG   ] Got command RPT from MCS: ref #1232284
2019-01-20 21:18:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 21:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232284  12 58503 76709601 A  ERRORB˜™š'
2019-01-20 21:18:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 21:19:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 21:19:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:19:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 21:19:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:19:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:19:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:19:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:19:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:19:23 [DEBUG   ] Finished updating board flags in 1.188 seconds
2019-01-20 21:19:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 21:19:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 21:20:08 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-01-20 21:20:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:20:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:20:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:20:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:20:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:20:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:20:23 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-01-20 21:20:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 21:20:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 21:21:06 [DEBUG   ] Got command RPT from MCS: ref #1232293
2019-01-20 21:21:06 [DEBUG   ] summary = ERROR
2019-01-20 21:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232293  13 58503 76866765 A  ERRORERROR'
2019-01-20 21:21:06 [DEBUG   ] Got command RPT from MCS: ref #1232294
2019-01-20 21:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232294  77 58503 76866766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:21:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 21:21:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:21:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:21:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:21:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:21:23 [WARNING ] (13, 1, 'bot')
2019-01-20 21:21:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:21:23 [DEBUG   ] Finished updating board flags in 0.983 seconds
2019-01-20 21:21:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 21:21:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 21:22:00 [DEBUG   ] Got command TBN from MCS: ref #1232310
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-20 21:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1232310   8 58503 76920542 A  ERROR'
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1548019322']
2019-01-20 21:22:00 [DEBUG   ] spawn_process: at 2019-01-20 21:22:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1548019322']
2019-01-20 21:22:00 [INFO    ] Finished spawning TBN in 0.297 s
2019-01-20 21:22:08 [DEBUG   ] Finished updating ant stats in 0.670 seconds
2019-01-20 21:22:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:22:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 21:22:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:22:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:22:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:22:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:22:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:22:24 [DEBUG   ] Finished updating board flags in 2.037 seconds
2019-01-20 21:22:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 21:22:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 21:23:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 21:23:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:23:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:23:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:23:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:23:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:23:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:23:24 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-01-20 21:23:28 [DEBUG   ] Got command RPT from MCS: ref #1232315
2019-01-20 21:23:28 [DEBUG   ] summary = ERROR
2019-01-20 21:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232315  13 58503 77008881 A  ERRORERROR'
2019-01-20 21:23:29 [DEBUG   ] Got command RPT from MCS: ref #1232316
2019-01-20 21:23:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232316  77 58503 77009085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:23:29 [DEBUG   ] Got command RPT from MCS: ref #1232317
2019-01-20 21:23:29 [DEBUG   ] summary = ERROR
2019-01-20 21:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232317  13 58503 77009277 A  ERRORERROR'
2019-01-20 21:23:29 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-20 21:23:29 [DEBUG   ] Got command RPT from MCS: ref #1232318
2019-01-20 21:23:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232318  77 58503 77009506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:23:29 [DEBUG   ] Got command RPT from MCS: ref #1232319
2019-01-20 21:23:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 21:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232319  12 58503 77009686 A  ERRORB˜™š'
2019-01-20 21:23:49 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 21:24:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 21:24:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:24:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:24:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:24:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:24:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:24:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:24:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:24:24 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-20 21:24:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 21:24:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-20 21:25:09 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-01-20 21:25:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:25:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:25:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:25:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:25:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:25:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:25:24 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-01-20 21:25:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 21:25:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 21:26:06 [DEBUG   ] Got command RPT from MCS: ref #1232324
2019-01-20 21:26:06 [DEBUG   ] summary = ERROR
2019-01-20 21:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232324  13 58503 77166761 A  ERRORERROR'
2019-01-20 21:26:06 [DEBUG   ] Got command RPT from MCS: ref #1232325
2019-01-20 21:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232325  77 58503 77166762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:26:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-20 21:26:11 [DEBUG   ] Got command TBW from MCS: ref #1232342
2019-01-20 21:26:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-20 21:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1232342   8 58503 77171602 A  ERROR'
2019-01-20 21:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-20 21:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-20 21:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-20 21:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-20 21:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-20 21:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-20 21:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-20 21:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-20 21:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-20 21:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-20 21:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-20 21:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-20 21:26:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-20 21:26:15 [DEBUG   ] spawn_process: at 2019-01-20 21:26:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-20 21:26:15 [INFO    ] Finished spawning TBW
2019-01-20 21:26:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:26:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:26:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:26:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:26:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:26:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:26:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:26:24 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-01-20 21:27:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:27:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:27:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:27:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:27:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:27:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:27:24 [DEBUG   ] Finished updating board flags in 1.536 seconds
2019-01-20 21:28:03 [INFO    ] __waitForTBW - TBW finished in 108.669 s
2019-01-20 21:28:04 [DEBUG   ] Finished updating ant stats in 0.473 seconds
2019-01-20 21:28:04 [INFO    ] Started antennas statistics background thread
2019-01-20 21:28:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1548019686']
2019-01-20 21:28:04 [DEBUG   ] spawn_process: at 2019-01-20 21:28:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1548019686']
2019-01-20 21:28:04 [INFO    ] Finished spawning TBN in 0.049 s
2019-01-20 21:28:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:28:24 [DEBUG   ] Finished updating ant stats in 0.473 seconds
2019-01-20 21:28:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:28:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 21:28:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:28:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:28:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:28:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:28:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:28:25 [DEBUG   ] Finished updating board flags in 2.024 seconds
2019-01-20 21:28:28 [DEBUG   ] Got command RPT from MCS: ref #1232350
2019-01-20 21:28:28 [DEBUG   ] summary = ERROR
2019-01-20 21:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232350  13 58503 77308961 A  ERRORERROR'
2019-01-20 21:28:29 [DEBUG   ] Got command RPT from MCS: ref #1232351
2019-01-20 21:28:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232351  77 58503 77309153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:28:29 [DEBUG   ] Got command RPT from MCS: ref #1232352
2019-01-20 21:28:29 [DEBUG   ] summary = ERROR
2019-01-20 21:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232352  13 58503 77309357 A  ERRORERROR'
2019-01-20 21:28:29 [DEBUG   ] Got command RPT from MCS: ref #1232354
2019-01-20 21:28:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232354  77 58503 77309561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:28:29 [DEBUG   ] Got command RPT from MCS: ref #1232355
2019-01-20 21:28:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 21:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232355  12 58503 77309765 A  ERRORB˜™š'
2019-01-20 21:28:44 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-20 21:29:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:29:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:29:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:29:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:29:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:29:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:29:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:29:24 [DEBUG   ] Finished updating board flags in 1.503 seconds
2019-01-20 21:29:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 21:29:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:30:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 21:30:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:30:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:30:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:30:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:30:24 [WARNING ] (13, 1, 'bot')
2019-01-20 21:30:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:30:24 [DEBUG   ] Finished updating board flags in 1.548 seconds
2019-01-20 21:30:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 21:30:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 21:31:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 21:31:06 [DEBUG   ] Got command RPT from MCS: ref #1232366
2019-01-20 21:31:06 [DEBUG   ] summary = ERROR
2019-01-20 21:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232366  13 58503 77466765 A  ERRORERROR'
2019-01-20 21:31:06 [DEBUG   ] Got command RPT from MCS: ref #1232367
2019-01-20 21:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232367  77 58503 77466766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:31:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 21:31:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:31:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:31:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:31:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:31:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:31:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:31:26 [DEBUG   ] Finished updating board flags in 3.176 seconds
2019-01-20 21:31:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 21:32:05 [DEBUG   ] Finished updating ant stats in 0.982 seconds
2019-01-20 21:32:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:32:25 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2019-01-20 21:32:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:32:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:32:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:32:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:32:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:32:25 [DEBUG   ] Finished updating board flags in 2.047 seconds
2019-01-20 21:32:45 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2019-01-20 21:33:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 21:33:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:33:25 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2019-01-20 21:33:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:33:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:33:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:33:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:33:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:33:25 [DEBUG   ] Finished updating board flags in 2.031 seconds
2019-01-20 21:33:29 [DEBUG   ] Got command RPT from MCS: ref #1232387
2019-01-20 21:33:29 [DEBUG   ] summary = ERROR
2019-01-20 21:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232387  13 58503 77609041 A  ERRORERROR'
2019-01-20 21:33:29 [DEBUG   ] Got command RPT from MCS: ref #1232388
2019-01-20 21:33:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232388  77 58503 77609245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:33:29 [DEBUG   ] Got command RPT from MCS: ref #1232389
2019-01-20 21:33:29 [DEBUG   ] summary = ERROR
2019-01-20 21:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232389  13 58503 77609437 A  ERRORERROR'
2019-01-20 21:33:29 [DEBUG   ] Got command RPT from MCS: ref #1232390
2019-01-20 21:33:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232390  77 58503 77609641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:33:29 [DEBUG   ] Got command RPT from MCS: ref #1232391
2019-01-20 21:33:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 21:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232391  12 58503 77609845 A  ERRORB˜™š'
2019-01-20 21:33:46 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2019-01-20 21:34:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 21:34:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:34:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:34:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:34:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:34:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:34:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:34:25 [DEBUG   ] Finished updating board flags in 1.960 seconds
2019-01-20 21:34:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 21:34:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 21:35:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 21:35:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:35:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:35:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:35:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:35:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:35:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:35:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:35:25 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-01-20 21:35:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 21:35:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 21:36:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 21:36:06 [DEBUG   ] Got command RPT from MCS: ref #1232396
2019-01-20 21:36:06 [DEBUG   ] summary = ERROR
2019-01-20 21:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232396  13 58503 77766769 A  ERRORERROR'
2019-01-20 21:36:06 [DEBUG   ] Got command RPT from MCS: ref #1232397
2019-01-20 21:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232397  77 58503 77766770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:36:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:36:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:36:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:36:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:36:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:36:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:36:25 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-01-20 21:36:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 21:36:47 [DEBUG   ] Finished updating ant stats in 1.799 seconds
2019-01-20 21:37:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 21:37:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:37:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:37:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:37:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:37:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:37:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:37:25 [DEBUG   ] Finished updating board flags in 1.763 seconds
2019-01-20 21:37:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 21:37:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-20 21:38:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 21:38:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:38:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 21:38:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:38:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:38:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:38:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:38:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:38:25 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-20 21:38:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 21:38:29 [DEBUG   ] Got command RPT from MCS: ref #1232419
2019-01-20 21:38:29 [DEBUG   ] summary = ERROR
2019-01-20 21:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232419  13 58503 77909113 A  ERRORERROR'
2019-01-20 21:38:29 [DEBUG   ] Got command RPT from MCS: ref #1232420
2019-01-20 21:38:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232420  77 58503 77909317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:38:29 [DEBUG   ] Got command RPT from MCS: ref #1232421
2019-01-20 21:38:29 [DEBUG   ] summary = ERROR
2019-01-20 21:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232421  13 58503 77909521 A  ERRORERROR'
2019-01-20 21:38:29 [DEBUG   ] Got command RPT from MCS: ref #1232423
2019-01-20 21:38:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232423  77 58503 77909725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:38:29 [DEBUG   ] Got command RPT from MCS: ref #1232424
2019-01-20 21:38:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 21:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232424  12 58503 77909917 A  ERRORB˜™š'
2019-01-20 21:38:46 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-20 21:39:07 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-20 21:39:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:39:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:39:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:39:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:39:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:39:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:39:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:39:25 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-20 21:39:27 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 21:39:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-20 21:40:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 21:40:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:40:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:40:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:40:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:40:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:40:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:40:25 [DEBUG   ] Finished updating board flags in 1.384 seconds
2019-01-20 21:40:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 21:40:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 21:41:06 [DEBUG   ] Got command RPT from MCS: ref #1232437
2019-01-20 21:41:06 [DEBUG   ] summary = ERROR
2019-01-20 21:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232437  13 58503 78066769 A  ERRORERROR'
2019-01-20 21:41:06 [DEBUG   ] Got command RPT from MCS: ref #1232438
2019-01-20 21:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232438  77 58503 78066770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:41:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 21:41:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:41:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:41:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:41:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:41:25 [WARNING ] (13, 1, 'bot')
2019-01-20 21:41:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:41:25 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-01-20 21:41:27 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-20 21:41:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 21:42:07 [DEBUG   ] Finished updating ant stats in 0.790 seconds
2019-01-20 21:42:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:42:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:42:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 21:42:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:42:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:42:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:42:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:42:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:42:26 [DEBUG   ] Finished updating board flags in 2.070 seconds
2019-01-20 21:42:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 21:42:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 21:43:08 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 21:43:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:43:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:43:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:43:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:43:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:43:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:43:26 [DEBUG   ] Finished updating board flags in 1.978 seconds
2019-01-20 21:43:28 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-20 21:43:29 [DEBUG   ] Got command RPT from MCS: ref #1232462
2019-01-20 21:43:29 [DEBUG   ] summary = ERROR
2019-01-20 21:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232462  13 58503 78209205 A  ERRORERROR'
2019-01-20 21:43:29 [DEBUG   ] Got command RPT from MCS: ref #1232463
2019-01-20 21:43:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232463  77 58503 78209409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:43:29 [DEBUG   ] Got command RPT from MCS: ref #1232464
2019-01-20 21:43:29 [DEBUG   ] summary = ERROR
2019-01-20 21:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232464  13 58503 78209601 A  ERRORERROR'
2019-01-20 21:43:29 [DEBUG   ] Got command RPT from MCS: ref #1232465
2019-01-20 21:43:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232465  77 58503 78209805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:43:30 [DEBUG   ] Got command RPT from MCS: ref #1232466
2019-01-20 21:43:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 21:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232466  12 58503 78210009 A  ERRORB˜™š'
2019-01-20 21:43:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 21:44:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 21:44:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 21:44:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:44:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:44:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:44:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:44:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:44:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:44:26 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-20 21:44:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 21:44:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 21:45:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 21:45:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:45:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:45:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:45:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:45:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:45:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:45:26 [DEBUG   ] Finished updating board flags in 1.781 seconds
2019-01-20 21:45:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 21:45:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 21:46:06 [DEBUG   ] Got command RPT from MCS: ref #1232471
2019-01-20 21:46:06 [DEBUG   ] summary = ERROR
2019-01-20 21:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232471  13 58503 78366769 A  ERRORERROR'
2019-01-20 21:46:06 [DEBUG   ] Got command RPT from MCS: ref #1232472
2019-01-20 21:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232472  77 58503 78366770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:46:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 21:46:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:46:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:46:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:46:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:46:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:46:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:46:26 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-20 21:46:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 21:46:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 21:47:09 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-20 21:47:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:47:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:47:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:47:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:47:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:47:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:47:26 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-01-20 21:47:28 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-20 21:47:48 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-01-20 21:48:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 21:48:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:48:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:48:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:48:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:48:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:48:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:48:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:48:26 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-20 21:48:29 [DEBUG   ] Got command RPT from MCS: ref #1232494
2019-01-20 21:48:29 [DEBUG   ] summary = ERROR
2019-01-20 21:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232494  13 58503 78509285 A  ERRORERROR'
2019-01-20 21:48:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 21:48:29 [DEBUG   ] Got command RPT from MCS: ref #1232495
2019-01-20 21:48:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232495  77 58503 78509489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:48:29 [DEBUG   ] Got command RPT from MCS: ref #1232496
2019-01-20 21:48:29 [DEBUG   ] summary = ERROR
2019-01-20 21:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232496  13 58503 78509681 A  ERRORERROR'
2019-01-20 21:48:29 [DEBUG   ] Got command RPT from MCS: ref #1232498
2019-01-20 21:48:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232498  77 58503 78509885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:48:30 [DEBUG   ] Got command RPT from MCS: ref #1232499
2019-01-20 21:48:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 21:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232499  12 58503 78510089 A  ERRORB˜™š'
2019-01-20 21:48:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 21:49:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 21:49:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:49:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:49:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:49:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:49:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:49:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:49:26 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-20 21:49:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 21:49:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 21:50:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 21:50:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:50:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:50:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:50:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:50:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:50:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:50:26 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-01-20 21:50:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 21:50:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 21:51:06 [DEBUG   ] Got command RPT from MCS: ref #1232508
2019-01-20 21:51:06 [DEBUG   ] summary = ERROR
2019-01-20 21:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232508  13 58503 78666765 A  ERRORERROR'
2019-01-20 21:51:06 [DEBUG   ] Got command RPT from MCS: ref #1232509
2019-01-20 21:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232509  77 58503 78666766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:51:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 21:51:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:51:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:51:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:51:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:51:26 [WARNING ] (13, 1, 'bot')
2019-01-20 21:51:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:51:26 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-01-20 21:51:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 21:51:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 21:52:10 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-20 21:52:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:52:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:52:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:52:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:52:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:52:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:52:27 [DEBUG   ] Finished updating board flags in 2.047 seconds
2019-01-20 21:52:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-20 21:52:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 21:53:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 21:53:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:53:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:53:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:53:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:53:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:53:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:53:27 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-20 21:53:29 [DEBUG   ] Got command RPT from MCS: ref #1232529
2019-01-20 21:53:29 [DEBUG   ] summary = ERROR
2019-01-20 21:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232529  13 58503 78809377 A  ERRORERROR'
2019-01-20 21:53:29 [DEBUG   ] Got command RPT from MCS: ref #1232530
2019-01-20 21:53:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232530  77 58503 78809581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:53:29 [DEBUG   ] Got command RPT from MCS: ref #1232531
2019-01-20 21:53:29 [DEBUG   ] summary = ERROR
2019-01-20 21:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232531  13 58503 78809773 A  ERRORERROR'
2019-01-20 21:53:29 [DEBUG   ] Got command RPT from MCS: ref #1232532
2019-01-20 21:53:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232532  77 58503 78809977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:53:30 [DEBUG   ] Got command RPT from MCS: ref #1232533
2019-01-20 21:53:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 21:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232533  12 58503 78810181 A  ERRORB˜™š'
2019-01-20 21:53:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 21:53:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 21:54:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 21:54:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 21:54:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:54:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:54:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:54:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:54:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:54:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:54:27 [DEBUG   ] Finished updating board flags in 1.828 seconds
2019-01-20 21:54:30 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 21:54:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 21:55:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 21:55:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:55:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:55:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:55:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:55:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:55:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:55:27 [DEBUG   ] Finished updating board flags in 1.851 seconds
2019-01-20 21:55:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 21:55:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 21:56:06 [DEBUG   ] Got command RPT from MCS: ref #1232538
2019-01-20 21:56:06 [DEBUG   ] summary = ERROR
2019-01-20 21:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232538  13 58503 78966769 A  ERRORERROR'
2019-01-20 21:56:06 [DEBUG   ] Got command RPT from MCS: ref #1232539
2019-01-20 21:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232539  77 58503 78966770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:56:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 21:56:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:56:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 21:56:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:56:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:56:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:56:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:56:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:56:27 [DEBUG   ] Finished updating board flags in 1.742 seconds
2019-01-20 21:56:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 21:56:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 21:57:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 21:57:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:57:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:57:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:57:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:57:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:57:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:57:27 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-01-20 21:57:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 21:57:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 21:58:11 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-20 21:58:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:58:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:58:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:58:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:58:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:58:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:58:27 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-01-20 21:58:29 [DEBUG   ] Got command RPT from MCS: ref #1232557
2019-01-20 21:58:29 [DEBUG   ] summary = ERROR
2019-01-20 21:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232557  13 58503 79109457 A  ERRORERROR'
2019-01-20 21:58:29 [DEBUG   ] Got command RPT from MCS: ref #1232558
2019-01-20 21:58:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232558  77 58503 79109661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:58:29 [DEBUG   ] Got command RPT from MCS: ref #1232559
2019-01-20 21:58:29 [DEBUG   ] summary = ERROR
2019-01-20 21:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232559  13 58503 79109865 A  ERRORERROR'
2019-01-20 21:58:30 [DEBUG   ] Got command RPT from MCS: ref #1232561
2019-01-20 21:58:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 21:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232561  77 58503 79110057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 21:58:30 [DEBUG   ] Got command RPT from MCS: ref #1232562
2019-01-20 21:58:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 21:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232562  12 58503 79110269 A  ERRORB˜™š'
2019-01-20 21:58:30 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-20 21:58:51 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-20 21:59:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 21:59:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 21:59:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 21:59:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:59:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:59:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:59:27 [WARNING ] (13, 1, 'bot')
2019-01-20 21:59:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 21:59:27 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-20 21:59:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 21:59:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 22:00:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 22:00:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 22:00:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:00:27 [WARNING ] (13, 1, 'bot')
2019-01-20 22:00:27 [WARNING ] (13, 1, 'bot')
2019-01-20 22:00:27 [WARNING ] (13, 1, 'bot')
2019-01-20 22:00:27 [WARNING ] (13, 1, 'bot')
2019-01-20 22:00:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:00:27 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-20 22:00:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 22:00:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-20 22:01:06 [DEBUG   ] Got command RPT from MCS: ref #1232571
2019-01-20 22:01:06 [DEBUG   ] summary = ERROR
2019-01-20 22:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232571  13 58503 79266773 A  ERRORERROR'
2019-01-20 22:01:06 [DEBUG   ] Got command RPT from MCS: ref #1232572
2019-01-20 22:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232572  77 58503 79266774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:01:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 22:01:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:01:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 22:01:27 [WARNING ] (13, 1, 'bot')
2019-01-20 22:01:27 [WARNING ] (13, 1, 'bot')
2019-01-20 22:01:27 [WARNING ] (13, 1, 'bot')
2019-01-20 22:01:27 [WARNING ] (13, 1, 'bot')
2019-01-20 22:01:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:01:27 [DEBUG   ] Finished updating board flags in 1.354 seconds
2019-01-20 22:01:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 22:01:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 22:02:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 22:02:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:02:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:02:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:02:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:02:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:02:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:02:28 [DEBUG   ] Finished updating board flags in 2.061 seconds
2019-01-20 22:02:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 22:02:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-20 22:03:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 22:03:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 22:03:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:03:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:03:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:03:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:03:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:03:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:03:28 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-20 22:03:29 [DEBUG   ] Got command RPT from MCS: ref #1232592
2019-01-20 22:03:29 [DEBUG   ] summary = ERROR
2019-01-20 22:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232592  13 58503 79409541 A  ERRORERROR'
2019-01-20 22:03:29 [DEBUG   ] Got command RPT from MCS: ref #1232593
2019-01-20 22:03:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232593  77 58503 79409745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:03:29 [DEBUG   ] Got command RPT from MCS: ref #1232594
2019-01-20 22:03:29 [DEBUG   ] summary = ERROR
2019-01-20 22:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232594  13 58503 79409949 A  ERRORERROR'
2019-01-20 22:03:30 [DEBUG   ] Got command RPT from MCS: ref #1232595
2019-01-20 22:03:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232595  77 58503 79410141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:03:30 [DEBUG   ] Got command RPT from MCS: ref #1232596
2019-01-20 22:03:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 22:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232596  12 58503 79410345 A  ERRORB˜™š'
2019-01-20 22:03:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 22:03:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 22:04:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 22:04:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:04:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:04:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:04:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:04:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:04:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:04:28 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-20 22:04:32 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 22:04:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 22:05:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 22:05:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:05:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 22:05:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:05:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:05:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:05:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:05:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:05:28 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-20 22:05:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 22:05:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-20 22:06:06 [DEBUG   ] Got command RPT from MCS: ref #1232601
2019-01-20 22:06:06 [DEBUG   ] summary = ERROR
2019-01-20 22:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232601  13 58503 79566769 A  ERRORERROR'
2019-01-20 22:06:06 [DEBUG   ] Got command RPT from MCS: ref #1232602
2019-01-20 22:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232602  77 58503 79566770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:06:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 22:06:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:06:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:06:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:06:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:06:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:06:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:06:28 [DEBUG   ] Finished updating board flags in 1.602 seconds
2019-01-20 22:06:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 22:06:53 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-20 22:07:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 22:07:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:07:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:07:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:07:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:07:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:07:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:07:28 [DEBUG   ] Finished updating board flags in 1.601 seconds
2019-01-20 22:07:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 22:07:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 22:08:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 22:08:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:08:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:08:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:08:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:08:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:08:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:08:28 [DEBUG   ] Finished updating board flags in 1.672 seconds
2019-01-20 22:08:29 [DEBUG   ] Got command RPT from MCS: ref #1232624
2019-01-20 22:08:29 [DEBUG   ] summary = ERROR
2019-01-20 22:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232624  13 58503 79709629 A  ERRORERROR'
2019-01-20 22:08:29 [DEBUG   ] Got command RPT from MCS: ref #1232625
2019-01-20 22:08:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232625  77 58503 79709833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:08:30 [DEBUG   ] Got command RPT from MCS: ref #1232626
2019-01-20 22:08:30 [DEBUG   ] summary = ERROR
2019-01-20 22:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232626  13 58503 79710037 A  ERRORERROR'
2019-01-20 22:08:30 [DEBUG   ] Got command RPT from MCS: ref #1232628
2019-01-20 22:08:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232628  77 58503 79710229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:08:30 [DEBUG   ] Got command RPT from MCS: ref #1232629
2019-01-20 22:08:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 22:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232629  12 58503 79710433 A  ERRORB˜™š'
2019-01-20 22:08:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 22:08:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 22:09:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 22:09:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:09:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:09:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:09:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:09:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:09:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:09:28 [DEBUG   ] Finished updating board flags in 1.527 seconds
2019-01-20 22:09:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 22:09:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 22:10:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 22:10:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:10:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:10:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:10:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:10:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:10:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:10:28 [DEBUG   ] Finished updating board flags in 1.446 seconds
2019-01-20 22:10:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 22:10:53 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 22:11:06 [DEBUG   ] Got command RPT from MCS: ref #1232638
2019-01-20 22:11:06 [DEBUG   ] summary = ERROR
2019-01-20 22:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232638  13 58503 79866777 A  ERRORERROR'
2019-01-20 22:11:06 [DEBUG   ] Got command RPT from MCS: ref #1232639
2019-01-20 22:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232639  77 58503 79866778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:11:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 22:11:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:11:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:11:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:11:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:11:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:11:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:11:28 [DEBUG   ] Finished updating board flags in 1.445 seconds
2019-01-20 22:11:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-20 22:11:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 22:12:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 22:12:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:12:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:12:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:12:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:12:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:12:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:12:28 [DEBUG   ] Finished updating board flags in 1.450 seconds
2019-01-20 22:12:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 22:12:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 22:13:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 22:13:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 22:13:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:13:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:13:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:13:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:13:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:13:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:13:28 [DEBUG   ] Finished updating board flags in 1.452 seconds
2019-01-20 22:13:29 [DEBUG   ] Got command RPT from MCS: ref #1232655
2019-01-20 22:13:29 [DEBUG   ] summary = ERROR
2019-01-20 22:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232655  13 58503 80009713 A  ERRORERROR'
2019-01-20 22:13:29 [DEBUG   ] Got command RPT from MCS: ref #1232656
2019-01-20 22:13:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232656  77 58503 80009917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:13:30 [DEBUG   ] Got command RPT from MCS: ref #1232657
2019-01-20 22:13:30 [DEBUG   ] summary = ERROR
2019-01-20 22:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232657  13 58503 80010121 A  ERRORERROR'
2019-01-20 22:13:30 [DEBUG   ] Got command RPT from MCS: ref #1232658
2019-01-20 22:13:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232658  77 58503 80010313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:13:30 [DEBUG   ] Got command RPT from MCS: ref #1232659
2019-01-20 22:13:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 22:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232659  12 58503 80010517 A  ERRORB˜™š'
2019-01-20 22:13:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 22:13:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 22:14:14 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 22:14:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:14:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:14:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:14:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:14:28 [WARNING ] (13, 1, 'bot')
2019-01-20 22:14:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:14:28 [DEBUG   ] Finished updating board flags in 1.453 seconds
2019-01-20 22:14:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-20 22:14:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 22:15:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 22:15:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:15:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:15:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:15:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:15:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:15:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:15:29 [DEBUG   ] Finished updating board flags in 2.180 seconds
2019-01-20 22:15:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 22:15:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 22:16:06 [DEBUG   ] Got command RPT from MCS: ref #1232664
2019-01-20 22:16:06 [DEBUG   ] summary = ERROR
2019-01-20 22:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232664  13 58503 80166781 A  ERRORERROR'
2019-01-20 22:16:06 [DEBUG   ] Got command RPT from MCS: ref #1232665
2019-01-20 22:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232665  77 58503 80166782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:16:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 22:16:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:16:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 22:16:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:16:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:16:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:16:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:16:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:16:29 [DEBUG   ] Finished updating board flags in 2.042 seconds
2019-01-20 22:16:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-20 22:16:55 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 22:17:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 22:17:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:17:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:17:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:17:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:17:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:17:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:17:29 [DEBUG   ] Finished updating board flags in 1.949 seconds
2019-01-20 22:17:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 22:17:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-20 22:18:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 22:18:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:18:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:18:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:18:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:18:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:18:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:18:29 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-01-20 22:18:29 [DEBUG   ] Got command RPT from MCS: ref #1232687
2019-01-20 22:18:29 [DEBUG   ] summary = ERROR
2019-01-20 22:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232687  13 58503 80309801 A  ERRORERROR'
2019-01-20 22:18:30 [DEBUG   ] Got command RPT from MCS: ref #1232688
2019-01-20 22:18:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232688  77 58503 80310005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:18:30 [DEBUG   ] Got command RPT from MCS: ref #1232689
2019-01-20 22:18:30 [DEBUG   ] summary = ERROR
2019-01-20 22:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232689  13 58503 80310197 A  ERRORERROR'
2019-01-20 22:18:30 [DEBUG   ] Got command RPT from MCS: ref #1232691
2019-01-20 22:18:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232691  77 58503 80310401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:18:30 [DEBUG   ] Got command RPT from MCS: ref #1232693
2019-01-20 22:18:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 22:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232693  12 58503 80310605 A  ERRORB˜™š'
2019-01-20 22:18:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 22:18:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 22:19:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 22:19:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:19:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:19:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:19:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:19:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:19:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:19:29 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-20 22:19:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 22:19:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 22:20:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 22:20:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 22:20:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:20:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:20:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:20:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:20:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:20:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:20:29 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-20 22:20:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 22:20:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 22:21:06 [DEBUG   ] Got command RPT from MCS: ref #1232701
2019-01-20 22:21:06 [DEBUG   ] summary = ERROR
2019-01-20 22:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232701  13 58503 80466777 A  ERRORERROR'
2019-01-20 22:21:06 [DEBUG   ] Got command RPT from MCS: ref #1232702
2019-01-20 22:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232702  77 58503 80466778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:21:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 22:21:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:21:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:21:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:21:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:21:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:21:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:21:29 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-20 22:21:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 22:21:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 22:22:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 22:22:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 22:22:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:22:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:22:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:22:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:22:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:22:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:22:29 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-20 22:22:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 22:22:56 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-20 22:23:16 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 22:23:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:23:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:23:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:23:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:23:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:23:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:23:29 [DEBUG   ] Finished updating board flags in 1.394 seconds
2019-01-20 22:23:29 [DEBUG   ] Got command RPT from MCS: ref #1232722
2019-01-20 22:23:29 [DEBUG   ] summary = ERROR
2019-01-20 22:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232722  13 58503 80609893 A  ERRORERROR'
2019-01-20 22:23:30 [DEBUG   ] Got command RPT from MCS: ref #1232723
2019-01-20 22:23:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232723  77 58503 80610085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:23:30 [DEBUG   ] Got command RPT from MCS: ref #1232724
2019-01-20 22:23:30 [DEBUG   ] summary = ERROR
2019-01-20 22:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232724  13 58503 80610289 A  ERRORERROR'
2019-01-20 22:23:30 [DEBUG   ] Got command RPT from MCS: ref #1232725
2019-01-20 22:23:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232725  77 58503 80610493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:23:30 [DEBUG   ] Got command RPT from MCS: ref #1232726
2019-01-20 22:23:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 22:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232726  12 58503 80610685 A  ERRORB˜™š'
2019-01-20 22:23:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-20 22:23:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 22:24:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 22:24:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 22:24:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:24:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 22:24:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:24:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:24:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:24:29 [WARNING ] (13, 1, 'bot')
2019-01-20 22:24:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:24:29 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-01-20 22:24:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 22:24:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 22:25:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 22:25:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:25:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:25:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:25:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:25:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:25:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:25:30 [DEBUG   ] Finished updating board flags in 2.043 seconds
2019-01-20 22:25:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 22:25:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 22:26:06 [DEBUG   ] Got command RPT from MCS: ref #1232731
2019-01-20 22:26:06 [DEBUG   ] summary = ERROR
2019-01-20 22:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232731  13 58503 80766777 A  ERRORERROR'
2019-01-20 22:26:06 [DEBUG   ] Got command RPT from MCS: ref #1232732
2019-01-20 22:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232732  77 58503 80766778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:26:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 22:26:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:26:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:26:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:26:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:26:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:26:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:26:30 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-01-20 22:26:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 22:26:56 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 22:27:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 22:27:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:27:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-01-20 22:27:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:27:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:27:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:27:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:27:30 [WARNING ] (25, 5, 'bot')
2019-01-20 22:27:30 [WARNING ] (25, 5, 'bot')
2019-01-20 22:27:30 [WARNING ] (25, 5, 'bot')
2019-01-20 22:27:30 [WARNING ] (25, 5, 'bot')
2019-01-20 22:27:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:27:30 [DEBUG   ] Finished updating board flags in 2.027 seconds
2019-01-20 22:27:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 22:27:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 22:28:16 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-20 22:28:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 22:28:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:28:29 [DEBUG   ] Got command RPT from MCS: ref #1232750
2019-01-20 22:28:29 [DEBUG   ] summary = ERROR
2019-01-20 22:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232750  13 58503 80909969 A  ERRORERROR'
2019-01-20 22:28:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 22:28:30 [DEBUG   ] Got command RPT from MCS: ref #1232751
2019-01-20 22:28:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232751  77 58503 80910177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:28:30 [DEBUG   ] Got command RPT from MCS: ref #1232752
2019-01-20 22:28:30 [DEBUG   ] summary = ERROR
2019-01-20 22:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232752  13 58503 80910369 A  ERRORERROR'
2019-01-20 22:28:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-01-20 22:28:30 [DEBUG   ] Got command RPT from MCS: ref #1232754
2019-01-20 22:28:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232754  77 58503 80910573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:28:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:28:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:28:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:28:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:28:30 [WARNING ] (25, 5, 'bot')
2019-01-20 22:28:30 [WARNING ] (25, 5, 'bot')
2019-01-20 22:28:30 [WARNING ] (25, 5, 'bot')
2019-01-20 22:28:30 [WARNING ] (25, 5, 'bot')
2019-01-20 22:28:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:28:30 [DEBUG   ] Finished updating board flags in 1.976 seconds
2019-01-20 22:28:30 [DEBUG   ] Got command RPT from MCS: ref #1232755
2019-01-20 22:28:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 22:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232755  12 58503 80910777 A  ERRORB™™š'
2019-01-20 22:28:37 [DEBUG   ] Finished updating ant stats in 1.387 seconds
2019-01-20 22:28:57 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-20 22:29:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 22:29:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:29:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 22:29:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:29:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:29:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:29:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:29:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:29:30 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-20 22:29:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 22:29:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 22:30:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 22:30:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:30:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:30:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:30:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:30:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:30:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:30:30 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-20 22:30:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 22:30:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 22:31:06 [DEBUG   ] Got command RPT from MCS: ref #1232764
2019-01-20 22:31:06 [DEBUG   ] summary = ERROR
2019-01-20 22:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232764  13 58503 81066781 A  ERRORERROR'
2019-01-20 22:31:06 [DEBUG   ] Got command RPT from MCS: ref #1232765
2019-01-20 22:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232765  77 58503 81066782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:31:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 22:31:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:31:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:31:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:31:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:31:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:31:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:31:30 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-20 22:31:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 22:31:57 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 22:32:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 22:32:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:32:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 22:32:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 22:32:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:32:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:32:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:32:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:32:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:32:30 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-20 22:32:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 22:32:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 22:33:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 22:33:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:33:30 [DEBUG   ] Got command RPT from MCS: ref #1232785
2019-01-20 22:33:30 [DEBUG   ] summary = ERROR
2019-01-20 22:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232785  13 58503 81210053 A  ERRORERROR'
2019-01-20 22:33:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 22:33:30 [DEBUG   ] Got command RPT from MCS: ref #1232786
2019-01-20 22:33:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232786  77 58503 81210262 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:33:30 [DEBUG   ] Got command RPT from MCS: ref #1232787
2019-01-20 22:33:30 [DEBUG   ] summary = ERROR
2019-01-20 22:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232787  13 58503 81210454 A  ERRORERROR'
2019-01-20 22:33:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:33:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:33:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:33:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:33:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:33:30 [DEBUG   ] Finished updating board flags in 1.576 seconds
2019-01-20 22:33:30 [DEBUG   ] Got command RPT from MCS: ref #1232788
2019-01-20 22:33:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232788  77 58503 81210657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:33:30 [DEBUG   ] Got command RPT from MCS: ref #1232789
2019-01-20 22:33:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 22:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232789  12 58503 81210861 A  ERRORB™™š'
2019-01-20 22:33:37 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-01-20 22:33:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 22:34:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 22:34:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:34:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:34:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:34:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:34:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:34:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:34:30 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-20 22:34:38 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-20 22:34:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-20 22:35:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 22:35:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:35:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:35:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:35:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:35:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:35:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:35:30 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-20 22:35:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 22:35:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 22:36:06 [DEBUG   ] Got command RPT from MCS: ref #1232794
2019-01-20 22:36:06 [DEBUG   ] summary = ERROR
2019-01-20 22:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232794  13 58503 81366781 A  ERRORERROR'
2019-01-20 22:36:06 [DEBUG   ] Got command RPT from MCS: ref #1232795
2019-01-20 22:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232795  77 58503 81366782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:36:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 22:36:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:36:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:36:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:36:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:36:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:36:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:36:30 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-01-20 22:36:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 22:36:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 22:37:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 22:37:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:37:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:37:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:37:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:37:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:37:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:37:30 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-20 22:37:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 22:37:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 22:38:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 22:38:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:38:30 [DEBUG   ] Got command RPT from MCS: ref #1232817
2019-01-20 22:38:30 [DEBUG   ] summary = ERROR
2019-01-20 22:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232817  13 58503 81510150 A  ERRORERROR'
2019-01-20 22:38:30 [DEBUG   ] Got command RPT from MCS: ref #1232818
2019-01-20 22:38:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232818  77 58503 81510342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:38:30 [DEBUG   ] Got command RPT from MCS: ref #1232819
2019-01-20 22:38:30 [DEBUG   ] summary = ERROR
2019-01-20 22:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232819  13 58503 81510538 A  ERRORERROR'
2019-01-20 22:38:30 [DEBUG   ] Got command RPT from MCS: ref #1232820
2019-01-20 22:38:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232820  77 58503 81510741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:38:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:38:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:38:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:38:30 [WARNING ] (13, 1, 'bot')
2019-01-20 22:38:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:38:30 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-01-20 22:38:30 [DEBUG   ] Got command RPT from MCS: ref #1232822
2019-01-20 22:38:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 22:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232822  12 58503 81510949 A  ERRORB™™š'
2019-01-20 22:38:38 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 22:38:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 22:39:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 22:39:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-20 22:39:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:39:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 22:39:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:39:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:39:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:39:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:39:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:39:31 [DEBUG   ] Finished updating board flags in 2.055 seconds
2019-01-20 22:39:38 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 22:39:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 22:40:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 22:40:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:40:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:40:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:40:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:40:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:40:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:40:31 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-20 22:40:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-20 22:40:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 22:41:06 [DEBUG   ] Got command RPT from MCS: ref #1232831
2019-01-20 22:41:06 [DEBUG   ] summary = ERROR
2019-01-20 22:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232831  13 58503 81666785 A  ERRORERROR'
2019-01-20 22:41:06 [DEBUG   ] Got command RPT from MCS: ref #1232832
2019-01-20 22:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232832  77 58503 81666786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:41:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 22:41:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 22:41:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:41:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:41:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:41:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:41:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:41:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:41:31 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-20 22:41:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 22:41:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 22:42:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 22:42:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:42:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:42:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:42:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:42:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:42:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:42:31 [DEBUG   ] Finished updating board flags in 1.781 seconds
2019-01-20 22:42:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 22:42:59 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 22:43:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 22:43:30 [DEBUG   ] Got command RPT from MCS: ref #1232848
2019-01-20 22:43:30 [DEBUG   ] summary = ERROR
2019-01-20 22:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232848  13 58503 81810225 A  ERRORERROR'
2019-01-20 22:43:30 [DEBUG   ] Got command RPT from MCS: ref #1232849
2019-01-20 22:43:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232849  77 58503 81810430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:43:30 [DEBUG   ] Got command RPT from MCS: ref #1232850
2019-01-20 22:43:30 [DEBUG   ] summary = ERROR
2019-01-20 22:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232850  13 58503 81810633 A  ERRORERROR'
2019-01-20 22:43:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:43:30 [DEBUG   ] Got command RPT from MCS: ref #1232851
2019-01-20 22:43:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232851  77 58503 81810825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:43:31 [DEBUG   ] Got command RPT from MCS: ref #1232852
2019-01-20 22:43:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 22:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232852  12 58503 81811033 A  ERRORBŽÌÍ'
2019-01-20 22:43:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 22:43:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:43:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:43:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:43:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:43:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:43:31 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-20 22:43:39 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 22:43:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 22:44:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 22:44:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:44:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:44:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:44:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:44:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:44:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:44:31 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-20 22:44:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 22:45:00 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 22:45:20 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 22:45:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 22:45:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:45:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 22:45:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:45:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:45:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:45:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:45:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:45:31 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-20 22:45:40 [DEBUG   ] Finished updating ant stats in 1.164 seconds
2019-01-20 22:46:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 22:46:06 [DEBUG   ] Got command RPT from MCS: ref #1232857
2019-01-20 22:46:06 [DEBUG   ] summary = ERROR
2019-01-20 22:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232857  13 58503 81966785 A  ERRORERROR'
2019-01-20 22:46:06 [DEBUG   ] Got command RPT from MCS: ref #1232858
2019-01-20 22:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232858  77 58503 81966786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:46:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 22:46:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:46:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:46:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:46:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:46:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:46:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:46:31 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-01-20 22:46:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 22:47:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 22:47:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 22:47:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:47:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:47:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:47:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:47:31 [WARNING ] (13, 1, 'bot')
2019-01-20 22:47:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:47:31 [DEBUG   ] Finished updating board flags in 1.354 seconds
2019-01-20 22:47:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 22:48:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-20 22:48:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 22:48:30 [DEBUG   ] Got command RPT from MCS: ref #1232880
2019-01-20 22:48:30 [DEBUG   ] summary = ERROR
2019-01-20 22:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232880  13 58503 82110305 A  ERRORERROR'
2019-01-20 22:48:30 [DEBUG   ] Got command RPT from MCS: ref #1232881
2019-01-20 22:48:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232881  77 58503 82110509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:48:30 [DEBUG   ] Got command RPT from MCS: ref #1232882
2019-01-20 22:48:30 [DEBUG   ] summary = ERROR
2019-01-20 22:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232882  13 58503 82110713 A  ERRORERROR'
2019-01-20 22:48:30 [DEBUG   ] Got command RPT from MCS: ref #1232884
2019-01-20 22:48:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232884  77 58503 82110917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:48:31 [DEBUG   ] Got command RPT from MCS: ref #1232885
2019-01-20 22:48:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 22:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232885  12 58503 82111109 A  ERRORB…ÌÍ'
2019-01-20 22:48:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:48:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:48:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:48:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:48:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:48:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:48:32 [DEBUG   ] Finished updating board flags in 2.084 seconds
2019-01-20 22:48:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 22:49:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 22:49:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-20 22:49:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:49:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:49:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:49:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:49:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:49:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:49:32 [DEBUG   ] Finished updating board flags in 1.966 seconds
2019-01-20 22:49:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 22:50:01 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-01-20 22:50:21 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-20 22:50:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:50:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 22:50:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:50:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:50:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:50:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:50:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:50:32 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-01-20 22:50:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 22:51:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 22:51:06 [DEBUG   ] Got command RPT from MCS: ref #1232894
2019-01-20 22:51:06 [DEBUG   ] summary = ERROR
2019-01-20 22:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232894  13 58503 82266781 A  ERRORERROR'
2019-01-20 22:51:06 [DEBUG   ] Got command RPT from MCS: ref #1232895
2019-01-20 22:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232895  77 58503 82266782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:51:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 22:51:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:51:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:51:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:51:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:51:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:51:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:51:32 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-20 22:51:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-20 22:52:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 22:52:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 22:52:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:52:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:52:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:52:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:52:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:52:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:52:32 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-20 22:52:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 22:53:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 22:53:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 22:53:30 [DEBUG   ] Got command RPT from MCS: ref #1232915
2019-01-20 22:53:30 [DEBUG   ] summary = ERROR
2019-01-20 22:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232915  13 58503 82410393 A  ERRORERROR'
2019-01-20 22:53:30 [DEBUG   ] Got command RPT from MCS: ref #1232916
2019-01-20 22:53:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232916  77 58503 82410597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:53:30 [DEBUG   ] Got command RPT from MCS: ref #1232917
2019-01-20 22:53:30 [DEBUG   ] summary = ERROR
2019-01-20 22:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232917  13 58503 82410789 A  ERRORERROR'
2019-01-20 22:53:30 [DEBUG   ] Got command RPT from MCS: ref #1232918
2019-01-20 22:53:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232918  77 58503 82410993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:53:31 [DEBUG   ] Got command RPT from MCS: ref #1232919
2019-01-20 22:53:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 22:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232919  12 58503 82411197 A  ERRORB„ÌÍ'
2019-01-20 22:53:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:53:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:53:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:53:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:53:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:53:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:53:32 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-20 22:53:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 22:54:01 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-01-20 22:54:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 22:54:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:54:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:54:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:54:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:54:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:54:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:54:32 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-20 22:54:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 22:55:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 22:55:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 22:55:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 22:55:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:55:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:55:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:55:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:55:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:55:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:55:32 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-20 22:55:41 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-20 22:56:02 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-20 22:56:06 [DEBUG   ] Got command RPT from MCS: ref #1232924
2019-01-20 22:56:06 [DEBUG   ] summary = ERROR
2019-01-20 22:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232924  13 58503 82566785 A  ERRORERROR'
2019-01-20 22:56:06 [DEBUG   ] Got command RPT from MCS: ref #1232925
2019-01-20 22:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232925  77 58503 82566786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:56:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 22:56:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:56:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:56:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:56:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:56:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:56:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:56:32 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-20 22:56:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-20 22:57:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 22:57:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 22:57:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:57:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:57:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:57:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:57:32 [WARNING ] (13, 1, 'bot')
2019-01-20 22:57:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:57:32 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-01-20 22:57:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 22:58:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 22:58:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-20 22:58:30 [DEBUG   ] Got command RPT from MCS: ref #1232943
2019-01-20 22:58:30 [DEBUG   ] summary = ERROR
2019-01-20 22:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232943  13 58503 82710473 A  ERRORERROR'
2019-01-20 22:58:30 [DEBUG   ] Got command RPT from MCS: ref #1232944
2019-01-20 22:58:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232944  77 58503 82710677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:58:30 [DEBUG   ] Got command RPT from MCS: ref #1232945
2019-01-20 22:58:30 [DEBUG   ] summary = ERROR
2019-01-20 22:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232945  13 58503 82710881 A  ERRORERROR'
2019-01-20 22:58:31 [DEBUG   ] Got command RPT from MCS: ref #1232947
2019-01-20 22:58:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 22:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232947  77 58503 82711085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 22:58:31 [DEBUG   ] Got command RPT from MCS: ref #1232948
2019-01-20 22:58:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 22:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232948  12 58503 82711277 A  ERRORB™™š'
2019-01-20 22:58:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:58:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 22:58:33 [WARNING ] (13, 1, 'bot')
2019-01-20 22:58:33 [WARNING ] (13, 1, 'bot')
2019-01-20 22:58:33 [WARNING ] (13, 1, 'bot')
2019-01-20 22:58:33 [WARNING ] (13, 1, 'bot')
2019-01-20 22:58:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:58:33 [DEBUG   ] Finished updating board flags in 2.058 seconds
2019-01-20 22:58:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 22:59:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 22:59:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-20 22:59:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 22:59:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 22:59:33 [WARNING ] (13, 1, 'bot')
2019-01-20 22:59:33 [WARNING ] (13, 1, 'bot')
2019-01-20 22:59:33 [WARNING ] (13, 1, 'bot')
2019-01-20 22:59:33 [WARNING ] (13, 1, 'bot')
2019-01-20 22:59:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 22:59:33 [DEBUG   ] Finished updating board flags in 2.002 seconds
2019-01-20 22:59:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 23:00:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 23:00:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 23:00:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:00:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:00:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:00:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:00:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:00:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:00:33 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-20 23:00:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 23:01:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 23:01:06 [DEBUG   ] Got command RPT from MCS: ref #1232957
2019-01-20 23:01:06 [DEBUG   ] summary = ERROR
2019-01-20 23:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232957  13 58503 82866785 A  ERRORERROR'
2019-01-20 23:01:06 [DEBUG   ] Got command RPT from MCS: ref #1232958
2019-01-20 23:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232958  77 58503 82866786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:01:23 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-20 23:01:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:01:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:01:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:01:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:01:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:01:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:01:33 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-20 23:01:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-20 23:02:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 23:02:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 23:02:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:02:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 23:02:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:02:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:02:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:02:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:02:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:02:33 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-20 23:02:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 23:03:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 23:03:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 23:03:30 [DEBUG   ] Got command RPT from MCS: ref #1232978
2019-01-20 23:03:30 [DEBUG   ] summary = ERROR
2019-01-20 23:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232978  13 58503 83010672 A  ERRORERROR'
2019-01-20 23:03:30 [DEBUG   ] Got command RPT from MCS: ref #1232979
2019-01-20 23:03:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232979  77 58503 83010765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:03:30 [DEBUG   ] Got command RPT from MCS: ref #1232980
2019-01-20 23:03:30 [DEBUG   ] summary = ERROR
2019-01-20 23:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232980  13 58503 83010969 A  ERRORERROR'
2019-01-20 23:03:31 [DEBUG   ] Got command RPT from MCS: ref #1232981
2019-01-20 23:03:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232981  77 58503 83011162 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:03:31 [DEBUG   ] Got command RPT from MCS: ref #1232982
2019-01-20 23:03:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 23:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232982  12 58503 83011375 A  ERRORB™™š'
2019-01-20 23:03:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:03:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 23:03:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:03:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:03:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:03:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:03:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:03:33 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-20 23:03:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 23:04:03 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 23:04:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 23:04:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 23:04:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:04:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 23:04:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:04:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:04:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:04:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:04:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:04:33 [DEBUG   ] Finished updating board flags in 1.624 seconds
2019-01-20 23:04:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 23:05:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 23:05:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 23:05:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:05:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 23:05:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:05:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:05:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:05:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:05:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:05:33 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-01-20 23:05:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 23:06:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 23:06:06 [DEBUG   ] Got command RPT from MCS: ref #1232987
2019-01-20 23:06:06 [DEBUG   ] summary = ERROR
2019-01-20 23:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232987  13 58503 83166789 A  ERRORERROR'
2019-01-20 23:06:06 [DEBUG   ] Got command RPT from MCS: ref #1232988
2019-01-20 23:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1232988  77 58503 83166790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:06:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 23:06:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 23:06:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:06:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:06:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:06:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:06:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:06:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:06:33 [DEBUG   ] Finished updating board flags in 1.402 seconds
2019-01-20 23:06:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 23:07:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 23:07:24 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-20 23:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:07:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:07:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:07:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:07:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:07:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:07:33 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-01-20 23:07:44 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 23:08:04 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-01-20 23:08:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 23:08:30 [DEBUG   ] Got command RPT from MCS: ref #1233010
2019-01-20 23:08:30 [DEBUG   ] summary = ERROR
2019-01-20 23:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233010  13 58503 83310649 A  ERRORERROR'
2019-01-20 23:08:30 [DEBUG   ] Got command RPT from MCS: ref #1233011
2019-01-20 23:08:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233011  77 58503 83310853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:08:31 [DEBUG   ] Got command RPT from MCS: ref #1233012
2019-01-20 23:08:31 [DEBUG   ] summary = ERROR
2019-01-20 23:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233012  13 58503 83311045 A  ERRORERROR'
2019-01-20 23:08:31 [DEBUG   ] Got command RPT from MCS: ref #1233014
2019-01-20 23:08:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233014  77 58503 83311249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:08:31 [DEBUG   ] Got command RPT from MCS: ref #1233016
2019-01-20 23:08:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 23:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233016  12 58503 83311453 A  ERRORB™™š'
2019-01-20 23:08:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:08:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:08:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:08:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:08:33 [WARNING ] (13, 1, 'bot')
2019-01-20 23:08:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:08:33 [DEBUG   ] Finished updating board flags in 1.351 seconds
2019-01-20 23:08:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 23:09:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 23:09:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 23:09:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 23:09:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:09:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:09:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:09:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:09:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:09:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:09:34 [DEBUG   ] Finished updating board flags in 2.134 seconds
2019-01-20 23:09:44 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 23:10:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 23:10:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 23:10:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:10:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:10:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:10:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:10:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:10:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:10:34 [DEBUG   ] Finished updating board flags in 1.926 seconds
2019-01-20 23:10:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 23:11:05 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-20 23:11:06 [DEBUG   ] Got command RPT from MCS: ref #1233024
2019-01-20 23:11:06 [DEBUG   ] summary = ERROR
2019-01-20 23:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233024  13 58503 83466785 A  ERRORERROR'
2019-01-20 23:11:06 [DEBUG   ] Got command RPT from MCS: ref #1233025
2019-01-20 23:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233025  77 58503 83466786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:11:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-20 23:11:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:11:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:11:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:11:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:11:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:11:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:11:34 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-01-20 23:11:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 23:12:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 23:12:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 23:12:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:12:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:12:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:12:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:12:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:12:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:12:34 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-20 23:12:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 23:13:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 23:13:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 23:13:30 [DEBUG   ] Got command RPT from MCS: ref #1233041
2019-01-20 23:13:30 [DEBUG   ] summary = ERROR
2019-01-20 23:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233041  13 58503 83610729 A  ERRORERROR'
2019-01-20 23:13:30 [DEBUG   ] Got command RPT from MCS: ref #1233042
2019-01-20 23:13:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233042  77 58503 83610933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:13:31 [DEBUG   ] Got command RPT from MCS: ref #1233043
2019-01-20 23:13:31 [DEBUG   ] summary = ERROR
2019-01-20 23:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233043  13 58503 83611137 A  ERRORERROR'
2019-01-20 23:13:31 [DEBUG   ] Got command RPT from MCS: ref #1233044
2019-01-20 23:13:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233044  77 58503 83611341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:13:31 [DEBUG   ] Got command RPT from MCS: ref #1233045
2019-01-20 23:13:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 23:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233045  12 58503 83611533 A  ERRORB™™š'
2019-01-20 23:13:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:13:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:13:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:13:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:13:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:13:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:13:34 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-20 23:13:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 23:14:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 23:14:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 23:14:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 23:14:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:14:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:14:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:14:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:14:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:14:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:14:34 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-01-20 23:14:45 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 23:15:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-20 23:15:26 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-20 23:15:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:15:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:15:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:15:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:15:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:15:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:15:34 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-20 23:15:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-20 23:16:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 23:16:06 [DEBUG   ] Got command RPT from MCS: ref #1233050
2019-01-20 23:16:06 [DEBUG   ] summary = ERROR
2019-01-20 23:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233050  13 58503 83766785 A  ERRORERROR'
2019-01-20 23:16:06 [DEBUG   ] Got command RPT from MCS: ref #1233051
2019-01-20 23:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233051  77 58503 83766786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:16:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 23:16:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:16:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:16:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:16:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:16:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:16:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:16:34 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-01-20 23:16:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 23:17:06 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-20 23:17:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 23:17:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 23:17:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:17:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:17:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:17:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:17:34 [WARNING ] (13, 1, 'bot')
2019-01-20 23:17:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:17:34 [DEBUG   ] Finished updating board flags in 1.374 seconds
2019-01-20 23:17:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 23:18:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 23:18:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 23:18:30 [DEBUG   ] Got command RPT from MCS: ref #1233073
2019-01-20 23:18:30 [DEBUG   ] summary = ERROR
2019-01-20 23:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233073  13 58503 83910821 A  ERRORERROR'
2019-01-20 23:18:31 [DEBUG   ] Got command RPT from MCS: ref #1233074
2019-01-20 23:18:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233074  77 58503 83911025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:18:31 [DEBUG   ] Got command RPT from MCS: ref #1233075
2019-01-20 23:18:31 [DEBUG   ] summary = ERROR
2019-01-20 23:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233075  13 58503 83911217 A  ERRORERROR'
2019-01-20 23:18:31 [DEBUG   ] Got command RPT from MCS: ref #1233077
2019-01-20 23:18:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233077  77 58503 83911421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:18:31 [DEBUG   ] Got command RPT from MCS: ref #1233078
2019-01-20 23:18:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 23:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233078  12 58503 83911625 A  ERRORB™™š'
2019-01-20 23:18:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:18:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:18:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:18:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:18:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:18:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:18:35 [DEBUG   ] Finished updating board flags in 2.039 seconds
2019-01-20 23:18:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 23:19:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 23:19:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 23:19:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:19:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 23:19:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:19:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:19:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:19:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:19:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:19:35 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-20 23:19:47 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 23:20:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 23:20:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 23:20:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:20:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 23:20:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:20:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:20:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:20:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:20:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:20:35 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-20 23:20:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 23:21:06 [DEBUG   ] Got command RPT from MCS: ref #1233087
2019-01-20 23:21:06 [DEBUG   ] summary = ERROR
2019-01-20 23:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233087  13 58503 84066789 A  ERRORERROR'
2019-01-20 23:21:06 [DEBUG   ] Got command RPT from MCS: ref #1233088
2019-01-20 23:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233088  77 58503 84066790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:21:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 23:21:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 23:21:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:21:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 23:21:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 23:21:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:21:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:21:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:21:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:21:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:21:35 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-20 23:21:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 23:22:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 23:22:27 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 23:22:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:22:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:22:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:22:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:22:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:22:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:22:35 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-20 23:22:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 23:23:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 23:23:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 23:23:30 [DEBUG   ] Got command RPT from MCS: ref #1233108
2019-01-20 23:23:30 [DEBUG   ] summary = ERROR
2019-01-20 23:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233108  13 58503 84210909 A  ERRORERROR'
2019-01-20 23:23:31 [DEBUG   ] Got command RPT from MCS: ref #1233109
2019-01-20 23:23:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233109  77 58503 84211101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:23:31 [DEBUG   ] Got command RPT from MCS: ref #1233110
2019-01-20 23:23:31 [DEBUG   ] summary = ERROR
2019-01-20 23:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233110  13 58503 84211305 A  ERRORERROR'
2019-01-20 23:23:31 [DEBUG   ] Got command RPT from MCS: ref #1233111
2019-01-20 23:23:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233111  77 58503 84211509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:23:31 [DEBUG   ] Got command RPT from MCS: ref #1233112
2019-01-20 23:23:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 23:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233112  12 58503 84211701 A  ERRORB™™š'
2019-01-20 23:23:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-20 23:23:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:23:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:23:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:23:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:23:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:23:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:23:35 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-20 23:23:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 23:24:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 23:24:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 23:24:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:24:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:24:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:24:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:24:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:24:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:24:35 [DEBUG   ] Finished updating board flags in 1.578 seconds
2019-01-20 23:24:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-20 23:25:08 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 23:25:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 23:25:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 23:25:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:25:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:25:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:25:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:25:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:25:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:25:35 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-20 23:25:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 23:26:06 [DEBUG   ] Got command RPT from MCS: ref #1233117
2019-01-20 23:26:06 [DEBUG   ] summary = ERROR
2019-01-20 23:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233117  13 58503 84366793 A  ERRORERROR'
2019-01-20 23:26:06 [DEBUG   ] Got command RPT from MCS: ref #1233118
2019-01-20 23:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233118  77 58503 84366794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:26:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 23:26:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 23:26:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:26:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:26:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:26:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:26:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:26:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:26:35 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-01-20 23:26:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 23:27:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 23:27:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 23:27:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 23:27:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:27:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 23:27:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:27:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:27:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:27:35 [WARNING ] (13, 1, 'bot')
2019-01-20 23:27:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:27:35 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-01-20 23:27:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 23:28:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 23:28:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 23:28:30 [DEBUG   ] Got command RPT from MCS: ref #1233136
2019-01-20 23:28:30 [DEBUG   ] summary = ERROR
2019-01-20 23:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233136  13 58503 84510989 A  ERRORERROR'
2019-01-20 23:28:31 [DEBUG   ] Got command RPT from MCS: ref #1233137
2019-01-20 23:28:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233137  77 58503 84511193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:28:31 [DEBUG   ] Got command RPT from MCS: ref #1233138
2019-01-20 23:28:31 [DEBUG   ] summary = ERROR
2019-01-20 23:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233138  13 58503 84511397 A  ERRORERROR'
2019-01-20 23:28:31 [DEBUG   ] Got command RPT from MCS: ref #1233140
2019-01-20 23:28:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233140  77 58503 84511589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:28:31 [DEBUG   ] Got command RPT from MCS: ref #1233142
2019-01-20 23:28:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 23:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233142  12 58503 84511793 A  ERRORB˜™š'
2019-01-20 23:28:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:28:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:28:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:28:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:28:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:28:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:28:36 [DEBUG   ] Finished updating board flags in 2.047 seconds
2019-01-20 23:28:48 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 23:29:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 23:29:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 23:29:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:29:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:29:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:29:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:29:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:29:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:29:36 [DEBUG   ] Finished updating board flags in 1.978 seconds
2019-01-20 23:29:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 23:30:08 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-20 23:30:29 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-20 23:30:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:30:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-20 23:30:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:30:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:30:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:30:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:30:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:30:36 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-20 23:30:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 23:31:06 [DEBUG   ] Got command RPT from MCS: ref #1233150
2019-01-20 23:31:06 [DEBUG   ] summary = ERROR
2019-01-20 23:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233150  13 58503 84666789 A  ERRORERROR'
2019-01-20 23:31:06 [DEBUG   ] Got command RPT from MCS: ref #1233151
2019-01-20 23:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233151  77 58503 84666790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:31:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 23:31:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 23:31:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 23:31:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:31:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:31:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:31:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:31:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:31:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:31:36 [DEBUG   ] Finished updating board flags in 1.804 seconds
2019-01-20 23:31:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 23:32:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 23:32:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 23:32:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:32:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:32:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:32:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:32:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:32:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:32:36 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-20 23:32:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 23:33:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 23:33:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 23:33:31 [DEBUG   ] Got command RPT from MCS: ref #1233171
2019-01-20 23:33:31 [DEBUG   ] summary = ERROR
2019-01-20 23:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233171  13 58503 84811073 A  ERRORERROR'
2019-01-20 23:33:31 [DEBUG   ] Got command RPT from MCS: ref #1233172
2019-01-20 23:33:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233172  77 58503 84811277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:33:31 [DEBUG   ] Got command RPT from MCS: ref #1233173
2019-01-20 23:33:31 [DEBUG   ] summary = ERROR
2019-01-20 23:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233173  13 58503 84811481 A  ERRORERROR'
2019-01-20 23:33:31 [DEBUG   ] Got command RPT from MCS: ref #1233174
2019-01-20 23:33:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233174  77 58503 84811685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:33:31 [DEBUG   ] Got command RPT from MCS: ref #1233175
2019-01-20 23:33:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 23:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233175  12 58503 84811877 A  ERRORB˜™š'
2019-01-20 23:33:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:33:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-20 23:33:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-20 23:33:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:33:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:33:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:33:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:33:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:33:36 [DEBUG   ] Finished updating board flags in 1.691 seconds
2019-01-20 23:33:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 23:34:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 23:34:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 23:34:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:34:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:34:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:34:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:34:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:34:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:34:36 [DEBUG   ] Finished updating board flags in 1.521 seconds
2019-01-20 23:34:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 23:35:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 23:35:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 23:35:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:35:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:35:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:35:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:35:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:35:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:35:36 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-01-20 23:35:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 23:36:06 [DEBUG   ] Got command RPT from MCS: ref #1233180
2019-01-20 23:36:06 [DEBUG   ] summary = ERROR
2019-01-20 23:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233180  13 58503 84966797 A  ERRORERROR'
2019-01-20 23:36:06 [DEBUG   ] Got command RPT from MCS: ref #1233181
2019-01-20 23:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233181  77 58503 84966798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:36:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 23:36:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 23:36:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:36:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:36:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:36:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:36:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:36:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:36:36 [DEBUG   ] Finished updating board flags in 1.426 seconds
2019-01-20 23:36:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 23:37:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 23:37:30 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-20 23:37:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:37:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:37:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:37:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:37:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:37:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:37:36 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-01-20 23:37:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 23:38:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 23:38:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 23:38:31 [DEBUG   ] Got command RPT from MCS: ref #1233203
2019-01-20 23:38:31 [DEBUG   ] summary = ERROR
2019-01-20 23:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233203  13 58503 85111161 A  ERRORERROR'
2019-01-20 23:38:31 [DEBUG   ] Got command RPT from MCS: ref #1233204
2019-01-20 23:38:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233204  77 58503 85111382 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:38:31 [DEBUG   ] Got command RPT from MCS: ref #1233205
2019-01-20 23:38:31 [DEBUG   ] summary = ERROR
2019-01-20 23:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233205  13 58503 85111561 A  ERRORERROR'
2019-01-20 23:38:31 [DEBUG   ] Got command RPT from MCS: ref #1233207
2019-01-20 23:38:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233207  77 58503 85111765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:38:31 [DEBUG   ] Got command RPT from MCS: ref #1233208
2019-01-20 23:38:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 23:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233208  12 58503 85111969 A  ERRORB˜™š'
2019-01-20 23:38:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 23:38:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:38:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:38:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:38:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:38:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:38:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:38:36 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-20 23:38:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 23:39:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-20 23:39:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 23:39:35 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 23:39:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:39:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:39:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:39:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:39:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:39:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:39:36 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-20 23:39:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 23:40:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 23:40:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 23:40:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:40:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:40:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:40:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:40:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:40:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:40:36 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-20 23:40:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 23:41:06 [DEBUG   ] Got command RPT from MCS: ref #1233217
2019-01-20 23:41:06 [DEBUG   ] summary = ERROR
2019-01-20 23:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233217  13 58503 85266797 A  ERRORERROR'
2019-01-20 23:41:06 [DEBUG   ] Got command RPT from MCS: ref #1233218
2019-01-20 23:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233218  77 58503 85266798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:41:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 23:41:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 23:41:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:41:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:41:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:41:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:41:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:41:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:41:36 [DEBUG   ] Finished updating board flags in 1.429 seconds
2019-01-20 23:41:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 23:42:10 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2019-01-20 23:42:31 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-20 23:42:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-20 23:42:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:42:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:42:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:42:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:42:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:42:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:42:36 [DEBUG   ] Finished updating board flags in 1.431 seconds
2019-01-20 23:42:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 23:43:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 23:43:31 [DEBUG   ] Got command RPT from MCS: ref #1233234
2019-01-20 23:43:31 [DEBUG   ] summary = ERROR
2019-01-20 23:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233234  13 58503 85411253 A  ERRORERROR'
2019-01-20 23:43:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-20 23:43:31 [DEBUG   ] Got command RPT from MCS: ref #1233235
2019-01-20 23:43:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233235  77 58503 85411445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:43:31 [DEBUG   ] Got command RPT from MCS: ref #1233236
2019-01-20 23:43:31 [DEBUG   ] summary = ERROR
2019-01-20 23:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233236  13 58503 85411649 A  ERRORERROR'
2019-01-20 23:43:31 [DEBUG   ] Got command RPT from MCS: ref #1233237
2019-01-20 23:43:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233237  77 58503 85411853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:43:32 [DEBUG   ] Got command RPT from MCS: ref #1233238
2019-01-20 23:43:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 23:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233238  12 58503 85412045 A  ERRORB˜™š'
2019-01-20 23:43:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:43:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:43:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:43:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:43:36 [WARNING ] (13, 1, 'bot')
2019-01-20 23:43:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:43:36 [DEBUG   ] Finished updating board flags in 1.431 seconds
2019-01-20 23:43:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 23:44:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 23:44:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-20 23:44:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:44:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:44:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:44:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:44:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:44:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:44:37 [DEBUG   ] Finished updating board flags in 2.209 seconds
2019-01-20 23:44:51 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-20 23:45:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 23:45:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 23:45:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:45:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:45:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:45:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:45:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:45:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:45:37 [DEBUG   ] Finished updating board flags in 2.181 seconds
2019-01-20 23:45:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-20 23:46:06 [DEBUG   ] Got command RPT from MCS: ref #1233243
2019-01-20 23:46:06 [DEBUG   ] summary = ERROR
2019-01-20 23:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233243  13 58503 85566797 A  ERRORERROR'
2019-01-20 23:46:06 [DEBUG   ] Got command RPT from MCS: ref #1233244
2019-01-20 23:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233244  77 58503 85566798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:46:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-20 23:46:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 23:46:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:46:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:46:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:46:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:46:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:46:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:46:37 [DEBUG   ] Finished updating board flags in 2.075 seconds
2019-01-20 23:46:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 23:47:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 23:47:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-20 23:47:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:47:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:47:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:47:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:47:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:47:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:47:37 [DEBUG   ] Finished updating board flags in 1.924 seconds
2019-01-20 23:47:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-20 23:48:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 23:48:31 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-20 23:48:31 [DEBUG   ] Got command RPT from MCS: ref #1233266
2019-01-20 23:48:31 [DEBUG   ] summary = ERROR
2019-01-20 23:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233266  13 58503 85711329 A  ERRORERROR'
2019-01-20 23:48:31 [DEBUG   ] Got command RPT from MCS: ref #1233267
2019-01-20 23:48:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233267  77 58503 85711533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:48:31 [DEBUG   ] Got command RPT from MCS: ref #1233268
2019-01-20 23:48:31 [DEBUG   ] summary = ERROR
2019-01-20 23:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233268  13 58503 85711737 A  ERRORERROR'
2019-01-20 23:48:31 [DEBUG   ] Got command RPT from MCS: ref #1233270
2019-01-20 23:48:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233270  77 58503 85711929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:48:32 [DEBUG   ] Got command RPT from MCS: ref #1233271
2019-01-20 23:48:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 23:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233271  12 58503 85712133 A  ERRORB˜™š'
2019-01-20 23:48:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:48:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:48:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:48:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:48:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:48:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:48:37 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-20 23:48:52 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-20 23:49:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-20 23:49:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 23:49:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:49:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:49:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:49:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:49:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:49:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:49:37 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-20 23:49:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 23:50:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-20 23:50:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 23:50:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:50:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:50:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:50:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:50:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:50:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:50:37 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-20 23:50:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 23:51:06 [DEBUG   ] Got command RPT from MCS: ref #1233280
2019-01-20 23:51:06 [DEBUG   ] summary = ERROR
2019-01-20 23:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233280  13 58503 85866801 A  ERRORERROR'
2019-01-20 23:51:06 [DEBUG   ] Got command RPT from MCS: ref #1233281
2019-01-20 23:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233281  77 58503 85866802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:51:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-20 23:51:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-20 23:51:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:51:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:51:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:51:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:51:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:51:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:51:37 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-20 23:51:52 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-20 23:52:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-20 23:52:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 23:52:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:52:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:52:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:52:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:52:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:52:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:52:37 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-20 23:52:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-20 23:53:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 23:53:31 [DEBUG   ] Got command RPT from MCS: ref #1233301
2019-01-20 23:53:31 [DEBUG   ] summary = ERROR
2019-01-20 23:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233301  13 58503 86011417 A  ERRORERROR'
2019-01-20 23:53:31 [DEBUG   ] Got command RPT from MCS: ref #1233302
2019-01-20 23:53:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233302  77 58503 86011621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:53:31 [DEBUG   ] Got command RPT from MCS: ref #1233303
2019-01-20 23:53:31 [DEBUG   ] summary = ERROR
2019-01-20 23:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233303  13 58503 86011813 A  ERRORERROR'
2019-01-20 23:53:32 [DEBUG   ] Got command RPT from MCS: ref #1233304
2019-01-20 23:53:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233304  77 58503 86012017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:53:32 [DEBUG   ] Got command RPT from MCS: ref #1233305
2019-01-20 23:53:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 23:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233305  12 58503 86012221 A  ERRORB˜™š'
2019-01-20 23:53:33 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-20 23:53:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:53:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:53:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:53:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:53:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:53:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:53:37 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-20 23:53:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 23:54:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-20 23:54:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-20 23:54:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:54:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:54:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:54:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:54:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:54:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:54:37 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-20 23:54:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-20 23:55:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-20 23:55:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 23:55:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:55:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:55:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:55:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:55:37 [WARNING ] (13, 1, 'bot')
2019-01-20 23:55:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:55:37 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-01-20 23:55:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-20 23:56:06 [DEBUG   ] Got command RPT from MCS: ref #1233310
2019-01-20 23:56:06 [DEBUG   ] summary = ERROR
2019-01-20 23:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233310  13 58503 86166797 A  ERRORERROR'
2019-01-20 23:56:06 [DEBUG   ] Got command RPT from MCS: ref #1233311
2019-01-20 23:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233311  77 58503 86166798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:56:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-20 23:56:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-20 23:56:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:56:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:56:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:56:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:56:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:56:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:56:38 [DEBUG   ] Finished updating board flags in 2.075 seconds
2019-01-20 23:56:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 23:57:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-20 23:57:33 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-20 23:57:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:57:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:57:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:57:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:57:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:57:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:57:38 [DEBUG   ] Finished updating board flags in 1.964 seconds
2019-01-20 23:57:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-20 23:58:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 23:58:31 [DEBUG   ] Got command RPT from MCS: ref #1233329
2019-01-20 23:58:31 [DEBUG   ] summary = ERROR
2019-01-20 23:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233329  13 58503 86311505 A  ERRORERROR'
2019-01-20 23:58:31 [DEBUG   ] Got command RPT from MCS: ref #1233330
2019-01-20 23:58:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233330  77 58503 86311697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:58:31 [DEBUG   ] Got command RPT from MCS: ref #1233331
2019-01-20 23:58:31 [DEBUG   ] summary = ERROR
2019-01-20 23:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233331  13 58503 86311901 A  ERRORERROR'
2019-01-20 23:58:32 [DEBUG   ] Got command RPT from MCS: ref #1233332
2019-01-20 23:58:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-20 23:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233332  77 58503 86312105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-20 23:58:32 [DEBUG   ] Got command RPT from MCS: ref #1233335
2019-01-20 23:58:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-20 23:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233335  12 58503 86312309 A  ERRORB™™š'
2019-01-20 23:58:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-20 23:58:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:58:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-20 23:58:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:58:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:58:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:58:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:58:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:58:38 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-20 23:58:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-20 23:59:13 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-20 23:59:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-20 23:59:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-20 23:59:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:59:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:59:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:59:38 [WARNING ] (13, 1, 'bot')
2019-01-20 23:59:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-20 23:59:38 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-20 23:59:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 00:00:14 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-21 00:00:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 00:00:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:00:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-21 00:00:38 [WARNING ] (13, 1, 'bot')
2019-01-21 00:00:38 [WARNING ] (13, 1, 'bot')
2019-01-21 00:00:38 [WARNING ] (13, 1, 'bot')
2019-01-21 00:00:38 [WARNING ] (13, 1, 'bot')
2019-01-21 00:00:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:00:38 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-01-21 00:00:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 00:01:06 [DEBUG   ] Got command RPT from MCS: ref #1233343
2019-01-21 00:01:06 [DEBUG   ] summary = ERROR
2019-01-21 00:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233343  13 58504    66793 A  ERRORERROR'
2019-01-21 00:01:06 [DEBUG   ] Got command RPT from MCS: ref #1233344
2019-01-21 00:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233344  77 58504    66794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:01:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 00:01:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 00:01:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:01:38 [WARNING ] (13, 1, 'bot')
2019-01-21 00:01:38 [WARNING ] (13, 1, 'bot')
2019-01-21 00:01:38 [WARNING ] (13, 1, 'bot')
2019-01-21 00:01:38 [WARNING ] (13, 1, 'bot')
2019-01-21 00:01:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:01:38 [DEBUG   ] Finished updating board flags in 1.399 seconds
2019-01-21 00:01:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 00:02:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 00:02:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 00:02:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:02:38 [WARNING ] (13, 1, 'bot')
2019-01-21 00:02:38 [WARNING ] (13, 1, 'bot')
2019-01-21 00:02:38 [WARNING ] (13, 1, 'bot')
2019-01-21 00:02:38 [WARNING ] (13, 1, 'bot')
2019-01-21 00:02:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:02:38 [DEBUG   ] Finished updating board flags in 1.354 seconds
2019-01-21 00:02:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 00:03:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 00:03:31 [DEBUG   ] Got command RPT from MCS: ref #1233364
2019-01-21 00:03:31 [DEBUG   ] summary = ERROR
2019-01-21 00:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233364  13 58504   211585 A  ERRORERROR'
2019-01-21 00:03:31 [DEBUG   ] Got command RPT from MCS: ref #1233365
2019-01-21 00:03:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233365  77 58504   211789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:03:31 [DEBUG   ] Got command RPT from MCS: ref #1233366
2019-01-21 00:03:31 [DEBUG   ] summary = ERROR
2019-01-21 00:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233366  13 58504   211993 A  ERRORERROR'
2019-01-21 00:03:32 [DEBUG   ] Got command RPT from MCS: ref #1233367
2019-01-21 00:03:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233367  77 58504   212185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:03:32 [DEBUG   ] Got command RPT from MCS: ref #1233368
2019-01-21 00:03:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 00:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233368  12 58504   212389 A  ERRORBš™š'
2019-01-21 00:03:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 00:03:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 00:03:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:03:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-21 00:03:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:03:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:03:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:03:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:03:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:03:39 [DEBUG   ] Finished updating board flags in 2.059 seconds
2019-01-21 00:03:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 00:04:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 00:04:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 00:04:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:04:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:04:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:04:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:04:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:04:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:04:39 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-01-21 00:04:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 00:05:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 00:05:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 00:05:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:05:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:05:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:05:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:05:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:05:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:05:39 [DEBUG   ] Finished updating board flags in 2.044 seconds
2019-01-21 00:05:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 00:06:06 [DEBUG   ] Got command RPT from MCS: ref #1233373
2019-01-21 00:06:06 [DEBUG   ] summary = ERROR
2019-01-21 00:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233373  13 58504   366801 A  ERRORERROR'
2019-01-21 00:06:06 [DEBUG   ] Got command RPT from MCS: ref #1233374
2019-01-21 00:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233374  77 58504   366802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:06:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 00:06:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 00:06:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 00:06:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:06:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:06:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:06:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:06:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:06:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:06:39 [DEBUG   ] Finished updating board flags in 1.948 seconds
2019-01-21 00:06:54 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 00:07:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 00:07:35 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 00:07:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:07:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:07:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:07:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:07:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:07:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:07:39 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-21 00:07:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 00:08:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 00:08:31 [DEBUG   ] Got command RPT from MCS: ref #1233396
2019-01-21 00:08:31 [DEBUG   ] summary = ERROR
2019-01-21 00:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233396  13 58504   511677 A  ERRORERROR'
2019-01-21 00:08:31 [DEBUG   ] Got command RPT from MCS: ref #1233397
2019-01-21 00:08:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233397  77 58504   511869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:08:32 [DEBUG   ] Got command RPT from MCS: ref #1233398
2019-01-21 00:08:32 [DEBUG   ] summary = ERROR
2019-01-21 00:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233398  13 58504   512073 A  ERRORERROR'
2019-01-21 00:08:32 [DEBUG   ] Got command RPT from MCS: ref #1233400
2019-01-21 00:08:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233400  77 58504   512277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:08:32 [DEBUG   ] Got command RPT from MCS: ref #1233401
2019-01-21 00:08:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 00:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233401  12 58504   512469 A  ERRORBš™š'
2019-01-21 00:08:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 00:08:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 00:08:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:08:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 00:08:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:08:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:08:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:08:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:08:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:08:39 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-21 00:08:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 00:09:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 00:09:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 00:09:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:09:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:09:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:09:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:09:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:09:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:09:39 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-21 00:09:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 00:10:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 00:10:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 00:10:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 00:10:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:10:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:10:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:10:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:10:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:10:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:10:39 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-21 00:10:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 00:11:06 [DEBUG   ] Got command RPT from MCS: ref #1233410
2019-01-21 00:11:06 [DEBUG   ] summary = ERROR
2019-01-21 00:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233410  13 58504   666801 A  ERRORERROR'
2019-01-21 00:11:06 [DEBUG   ] Got command RPT from MCS: ref #1233411
2019-01-21 00:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233411  77 58504   666802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:11:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 00:11:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 00:11:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:11:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:11:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:11:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:11:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:11:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:11:39 [DEBUG   ] Finished updating board flags in 1.439 seconds
2019-01-21 00:11:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 00:12:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 00:12:36 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-21 00:12:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:12:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:12:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:12:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:12:39 [WARNING ] (13, 1, 'bot')
2019-01-21 00:12:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:12:39 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-01-21 00:12:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 00:13:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 00:13:31 [DEBUG   ] Got command RPT from MCS: ref #1233427
2019-01-21 00:13:31 [DEBUG   ] summary = ERROR
2019-01-21 00:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233427  13 58504   811761 A  ERRORERROR'
2019-01-21 00:13:31 [DEBUG   ] Got command RPT from MCS: ref #1233428
2019-01-21 00:13:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233428  77 58504   811953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:13:32 [DEBUG   ] Got command RPT from MCS: ref #1233429
2019-01-21 00:13:32 [DEBUG   ] summary = ERROR
2019-01-21 00:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233429  13 58504   812157 A  ERRORERROR'
2019-01-21 00:13:32 [DEBUG   ] Got command RPT from MCS: ref #1233430
2019-01-21 00:13:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233430  77 58504   812361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:13:32 [DEBUG   ] Got command RPT from MCS: ref #1233431
2019-01-21 00:13:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 00:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233431  12 58504   812565 A  ERRORB™™š'
2019-01-21 00:13:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 00:13:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:13:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:13:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:13:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:13:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:13:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:13:40 [DEBUG   ] Finished updating board flags in 2.207 seconds
2019-01-21 00:13:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 00:14:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 00:14:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 00:14:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 00:14:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:14:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:14:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:14:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:14:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:14:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:14:40 [DEBUG   ] Finished updating board flags in 2.212 seconds
2019-01-21 00:14:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 00:15:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 00:15:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 00:15:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:15:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:15:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:15:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:15:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:15:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:15:40 [DEBUG   ] Finished updating board flags in 2.168 seconds
2019-01-21 00:15:56 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 00:16:06 [DEBUG   ] Got command RPT from MCS: ref #1233436
2019-01-21 00:16:06 [DEBUG   ] summary = ERROR
2019-01-21 00:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233436  13 58504   966797 A  ERRORERROR'
2019-01-21 00:16:06 [DEBUG   ] Got command RPT from MCS: ref #1233437
2019-01-21 00:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233437  77 58504   966798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:16:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 00:16:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 00:16:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:16:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:16:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:16:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:16:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:16:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:16:40 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-21 00:16:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 00:17:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 00:17:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 00:17:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:17:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-21 00:17:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:17:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:17:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:17:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:17:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:17:40 [DEBUG   ] Finished updating board flags in 2.039 seconds
2019-01-21 00:17:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 00:18:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 00:18:31 [DEBUG   ] Got command RPT from MCS: ref #1233459
2019-01-21 00:18:31 [DEBUG   ] summary = ERROR
2019-01-21 00:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233459  13 58504  1111845 A  ERRORERROR'
2019-01-21 00:18:32 [DEBUG   ] Got command RPT from MCS: ref #1233460
2019-01-21 00:18:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233460  77 58504  1112049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:18:32 [DEBUG   ] Got command RPT from MCS: ref #1233461
2019-01-21 00:18:32 [DEBUG   ] summary = ERROR
2019-01-21 00:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233461  13 58504  1112241 A  ERRORERROR'
2019-01-21 00:18:32 [DEBUG   ] Got command RPT from MCS: ref #1233463
2019-01-21 00:18:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233463  77 58504  1112445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:18:32 [DEBUG   ] Got command RPT from MCS: ref #1233464
2019-01-21 00:18:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 00:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233464  12 58504  1112649 A  ERRORB˜™š'
2019-01-21 00:18:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 00:18:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 00:18:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:18:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:18:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:18:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:18:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:18:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:18:40 [DEBUG   ] Finished updating board flags in 2.076 seconds
2019-01-21 00:18:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 00:19:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 00:19:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 00:19:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:19:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:19:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:19:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:19:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:19:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:19:40 [DEBUG   ] Finished updating board flags in 1.891 seconds
2019-01-21 00:19:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 00:20:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 00:20:37 [DEBUG   ] Finished updating ant stats in 1.597 seconds
2019-01-21 00:20:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:20:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:20:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:20:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:20:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:20:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:20:40 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-21 00:20:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 00:21:06 [DEBUG   ] Got command RPT from MCS: ref #1233473
2019-01-21 00:21:06 [DEBUG   ] summary = ERROR
2019-01-21 00:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233473  13 58504  1266801 A  ERRORERROR'
2019-01-21 00:21:06 [DEBUG   ] Got command RPT from MCS: ref #1233474
2019-01-21 00:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233474  77 58504  1266802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:21:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 00:21:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 00:21:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:21:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:21:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:21:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:21:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:21:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:21:40 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-01-21 00:21:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 00:22:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 00:22:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 00:22:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 00:22:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:22:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:22:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:22:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:22:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:22:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:22:40 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-21 00:22:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 00:23:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 00:23:31 [DEBUG   ] Got command RPT from MCS: ref #1233494
2019-01-21 00:23:31 [DEBUG   ] summary = ERROR
2019-01-21 00:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233494  13 58504  1411925 A  ERRORERROR'
2019-01-21 00:23:32 [DEBUG   ] Got command RPT from MCS: ref #1233495
2019-01-21 00:23:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233495  77 58504  1412129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:23:32 [DEBUG   ] Got command RPT from MCS: ref #1233496
2019-01-21 00:23:32 [DEBUG   ] summary = ERROR
2019-01-21 00:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233496  13 58504  1412333 A  ERRORERROR'
2019-01-21 00:23:32 [DEBUG   ] Got command RPT from MCS: ref #1233497
2019-01-21 00:23:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233497  77 58504  1412525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:23:32 [DEBUG   ] Got command RPT from MCS: ref #1233498
2019-01-21 00:23:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 00:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233498  12 58504  1412729 A  ERRORB˜™š'
2019-01-21 00:23:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 00:23:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:23:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:23:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:23:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:23:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:23:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:23:40 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-01-21 00:23:57 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-21 00:24:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 00:24:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 00:24:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:24:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:24:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:24:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:24:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:24:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:24:40 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-21 00:24:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 00:25:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 00:25:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 00:25:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:25:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:25:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:25:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:25:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:25:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:25:40 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-21 00:25:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 00:26:06 [DEBUG   ] Got command RPT from MCS: ref #1233503
2019-01-21 00:26:06 [DEBUG   ] summary = ERROR
2019-01-21 00:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233503  13 58504  1566805 A  ERRORERROR'
2019-01-21 00:26:06 [DEBUG   ] Got command RPT from MCS: ref #1233504
2019-01-21 00:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233504  77 58504  1566806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:26:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 00:26:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 00:26:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:26:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-21 00:26:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:26:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:26:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:26:40 [WARNING ] (13, 1, 'bot')
2019-01-21 00:26:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:26:40 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-01-21 00:26:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 00:27:18 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 00:27:38 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 00:27:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:27:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:27:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:27:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:27:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:27:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:27:41 [DEBUG   ] Finished updating board flags in 2.214 seconds
2019-01-21 00:27:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 00:28:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 00:28:32 [DEBUG   ] Got command RPT from MCS: ref #1233522
2019-01-21 00:28:32 [DEBUG   ] summary = ERROR
2019-01-21 00:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233522  13 58504  1712005 A  ERRORERROR'
2019-01-21 00:28:32 [DEBUG   ] Got command RPT from MCS: ref #1233523
2019-01-21 00:28:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233523  77 58504  1712209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:28:32 [DEBUG   ] Got command RPT from MCS: ref #1233524
2019-01-21 00:28:32 [DEBUG   ] summary = ERROR
2019-01-21 00:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233524  13 58504  1712413 A  ERRORERROR'
2019-01-21 00:28:32 [DEBUG   ] Got command RPT from MCS: ref #1233526
2019-01-21 00:28:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233526  77 58504  1712617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:28:32 [DEBUG   ] Got command RPT from MCS: ref #1233527
2019-01-21 00:28:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 00:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233527  12 58504  1712809 A  ERRORBš™š'
2019-01-21 00:28:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 00:28:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:28:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:28:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:28:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:28:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:28:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:28:41 [DEBUG   ] Finished updating board flags in 2.182 seconds
2019-01-21 00:28:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 00:29:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 00:29:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 00:29:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 00:29:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 00:29:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:29:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-21 00:29:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:29:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:29:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:29:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:29:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:29:41 [DEBUG   ] Finished updating board flags in 2.011 seconds
2019-01-21 00:29:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 00:30:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 00:30:38 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-21 00:30:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 00:30:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:30:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-21 00:30:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:30:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:30:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:30:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:30:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:30:41 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-01-21 00:30:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 00:31:06 [DEBUG   ] Got command RPT from MCS: ref #1233536
2019-01-21 00:31:06 [DEBUG   ] summary = ERROR
2019-01-21 00:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233536  13 58504  1866801 A  ERRORERROR'
2019-01-21 00:31:06 [DEBUG   ] Got command RPT from MCS: ref #1233537
2019-01-21 00:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233537  77 58504  1866802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:31:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 00:31:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 00:31:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:31:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 00:31:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-21 00:31:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:31:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:31:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:31:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:31:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:31:41 [DEBUG   ] Finished updating board flags in 1.969 seconds
2019-01-21 00:31:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 00:32:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 00:32:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 00:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:32:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:32:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:32:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:32:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:32:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:32:41 [DEBUG   ] Finished updating board flags in 1.884 seconds
2019-01-21 00:32:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 00:33:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 00:33:32 [DEBUG   ] Got command RPT from MCS: ref #1233557
2019-01-21 00:33:32 [DEBUG   ] summary = ERROR
2019-01-21 00:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233557  13 58504  2012097 A  ERRORERROR'
2019-01-21 00:33:32 [DEBUG   ] Got command RPT from MCS: ref #1233558
2019-01-21 00:33:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233558  77 58504  2012301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:33:32 [DEBUG   ] Got command RPT from MCS: ref #1233559
2019-01-21 00:33:32 [DEBUG   ] summary = ERROR
2019-01-21 00:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233559  13 58504  2012493 A  ERRORERROR'
2019-01-21 00:33:32 [DEBUG   ] Got command RPT from MCS: ref #1233560
2019-01-21 00:33:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233560  77 58504  2012697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:33:32 [DEBUG   ] Got command RPT from MCS: ref #1233561
2019-01-21 00:33:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 00:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233561  12 58504  2012901 A  ERRORBš™š'
2019-01-21 00:33:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 00:33:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:33:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 00:33:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-21 00:33:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:33:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:33:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:33:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:33:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:33:41 [DEBUG   ] Finished updating board flags in 1.726 seconds
2019-01-21 00:33:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 00:34:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 00:34:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 00:34:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:34:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:34:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:34:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:34:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:34:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:34:41 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-21 00:34:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 00:35:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 00:35:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 00:35:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:35:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:35:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:35:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:35:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:35:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:35:41 [DEBUG   ] Finished updating board flags in 1.642 seconds
2019-01-21 00:35:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 00:36:06 [DEBUG   ] Got command RPT from MCS: ref #1233566
2019-01-21 00:36:06 [DEBUG   ] summary = ERROR
2019-01-21 00:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233566  13 58504  2166805 A  ERRORERROR'
2019-01-21 00:36:06 [DEBUG   ] Got command RPT from MCS: ref #1233567
2019-01-21 00:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233567  77 58504  2166806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:36:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 00:36:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 00:36:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:36:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:36:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:36:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:36:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:36:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:36:41 [DEBUG   ] Finished updating board flags in 1.580 seconds
2019-01-21 00:36:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 00:37:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 00:37:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 00:37:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:37:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:37:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:37:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:37:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:37:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:37:41 [DEBUG   ] Finished updating board flags in 1.449 seconds
2019-01-21 00:37:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 00:38:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 00:38:32 [DEBUG   ] Got command RPT from MCS: ref #1233589
2019-01-21 00:38:32 [DEBUG   ] summary = ERROR
2019-01-21 00:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233589  13 58504  2312185 A  ERRORERROR'
2019-01-21 00:38:32 [DEBUG   ] Got command RPT from MCS: ref #1233590
2019-01-21 00:38:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233590  77 58504  2312377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:38:32 [DEBUG   ] Got command RPT from MCS: ref #1233591
2019-01-21 00:38:32 [DEBUG   ] summary = ERROR
2019-01-21 00:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233591  13 58504  2312581 A  ERRORERROR'
2019-01-21 00:38:32 [DEBUG   ] Got command RPT from MCS: ref #1233593
2019-01-21 00:38:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233593  77 58504  2312785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:38:32 [DEBUG   ] Got command RPT from MCS: ref #1233594
2019-01-21 00:38:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 00:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233594  12 58504  2312989 A  ERRORB™™š'
2019-01-21 00:38:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 00:38:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:38:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:38:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:38:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:38:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:38:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:38:41 [DEBUG   ] Finished updating board flags in 1.503 seconds
2019-01-21 00:38:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 00:39:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 00:39:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 00:39:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:39:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 00:39:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:39:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:39:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:39:41 [WARNING ] (13, 1, 'bot')
2019-01-21 00:39:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:39:41 [DEBUG   ] Finished updating board flags in 1.570 seconds
2019-01-21 00:39:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 00:40:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 00:40:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 00:40:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:40:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:40:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:40:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:40:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:40:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:40:42 [DEBUG   ] Finished updating board flags in 2.159 seconds
2019-01-21 00:40:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 00:41:06 [DEBUG   ] Got command RPT from MCS: ref #1233603
2019-01-21 00:41:06 [DEBUG   ] summary = ERROR
2019-01-21 00:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233603  13 58504  2466801 A  ERRORERROR'
2019-01-21 00:41:06 [DEBUG   ] Got command RPT from MCS: ref #1233604
2019-01-21 00:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233604  77 58504  2466802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:41:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 00:41:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 00:41:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:41:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:41:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:41:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:41:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:41:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:41:42 [DEBUG   ] Finished updating board flags in 1.907 seconds
2019-01-21 00:41:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 00:42:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 00:42:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 00:42:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:42:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:42:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:42:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:42:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:42:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:42:42 [DEBUG   ] Finished updating board flags in 1.852 seconds
2019-01-21 00:42:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 00:43:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 00:43:32 [DEBUG   ] Got command RPT from MCS: ref #1233620
2019-01-21 00:43:32 [DEBUG   ] summary = ERROR
2019-01-21 00:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233620  13 58504  2612265 A  ERRORERROR'
2019-01-21 00:43:32 [DEBUG   ] Got command RPT from MCS: ref #1233621
2019-01-21 00:43:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233621  77 58504  2612469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:43:32 [DEBUG   ] Got command RPT from MCS: ref #1233622
2019-01-21 00:43:32 [DEBUG   ] summary = ERROR
2019-01-21 00:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233622  13 58504  2612673 A  ERRORERROR'
2019-01-21 00:43:32 [DEBUG   ] Got command RPT from MCS: ref #1233623
2019-01-21 00:43:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233623  77 58504  2612873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:43:33 [DEBUG   ] Got command RPT from MCS: ref #1233624
2019-01-21 00:43:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 00:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233624  12 58504  2613065 A  ERRORB˜™š'
2019-01-21 00:43:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 00:43:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:43:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:43:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:43:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:43:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:43:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:43:42 [DEBUG   ] Finished updating board flags in 1.751 seconds
2019-01-21 00:43:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 00:44:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 00:44:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 00:44:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:44:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:44:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:44:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:44:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:44:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:44:42 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-21 00:44:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 00:45:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 00:45:39 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 00:45:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:45:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 00:45:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:45:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:45:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:45:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:45:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:45:42 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-21 00:45:59 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 00:46:06 [DEBUG   ] Got command RPT from MCS: ref #1233629
2019-01-21 00:46:06 [DEBUG   ] summary = ERROR
2019-01-21 00:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233629  13 58504  2766809 A  ERRORERROR'
2019-01-21 00:46:06 [DEBUG   ] Got command RPT from MCS: ref #1233630
2019-01-21 00:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233630  77 58504  2766810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:46:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 00:46:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 00:46:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 00:46:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:46:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:46:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:46:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:46:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:46:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:46:42 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-21 00:46:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 00:47:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 00:47:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 00:47:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:47:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:47:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:47:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:47:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:47:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:47:42 [DEBUG   ] Finished updating board flags in 1.538 seconds
2019-01-21 00:47:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 00:48:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 00:48:32 [DEBUG   ] Got command RPT from MCS: ref #1233652
2019-01-21 00:48:32 [DEBUG   ] summary = ERROR
2019-01-21 00:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233652  13 58504  2912353 A  ERRORERROR'
2019-01-21 00:48:32 [DEBUG   ] Got command RPT from MCS: ref #1233653
2019-01-21 00:48:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233653  77 58504  2912557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:48:32 [DEBUG   ] Got command RPT from MCS: ref #1233654
2019-01-21 00:48:32 [DEBUG   ] summary = ERROR
2019-01-21 00:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233654  13 58504  2912749 A  ERRORERROR'
2019-01-21 00:48:32 [DEBUG   ] Got command RPT from MCS: ref #1233656
2019-01-21 00:48:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233656  77 58504  2912953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:48:33 [DEBUG   ] Got command RPT from MCS: ref #1233657
2019-01-21 00:48:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 00:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233657  12 58504  2913157 A  ERRORB˜™š'
2019-01-21 00:48:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 00:48:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-21 00:48:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:48:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:48:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:48:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:48:42 [WARNING ] (13, 1, 'bot')
2019-01-21 00:48:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:48:42 [DEBUG   ] Finished updating board flags in 1.598 seconds
2019-01-21 00:48:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 00:49:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 00:49:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 00:49:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:49:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:49:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:49:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:49:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:49:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:49:43 [DEBUG   ] Finished updating board flags in 2.182 seconds
2019-01-21 00:49:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 00:50:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 00:50:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 00:50:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 00:50:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 00:50:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:50:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:50:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:50:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:50:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:50:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:50:43 [DEBUG   ] Finished updating board flags in 1.889 seconds
2019-01-21 00:50:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 00:51:06 [DEBUG   ] Got command RPT from MCS: ref #1233666
2019-01-21 00:51:06 [DEBUG   ] summary = ERROR
2019-01-21 00:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233666  13 58504  3066805 A  ERRORERROR'
2019-01-21 00:51:06 [DEBUG   ] Got command RPT from MCS: ref #1233667
2019-01-21 00:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233667  77 58504  3066806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:51:19 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-21 00:51:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 00:51:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:51:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-21 00:51:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:51:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:51:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:51:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:51:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:51:43 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-21 00:51:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 00:52:01 [DEBUG   ] Got command TBN from MCS: ref #1233683
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-21 00:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1233683   8 58504  3121005 A  ERROR'
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1548031922']
2019-01-21 00:52:01 [DEBUG   ] spawn_process: at 2019-01-21 00:52:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1548031922']
2019-01-21 00:52:01 [INFO    ] Finished spawning TBN in 0.052 s
2019-01-21 00:52:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 00:52:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 00:52:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:52:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:52:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:52:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:52:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:52:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:52:43 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-21 00:52:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 00:53:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 00:53:32 [DEBUG   ] Got command RPT from MCS: ref #1233688
2019-01-21 00:53:32 [DEBUG   ] summary = ERROR
2019-01-21 00:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233688  13 58504  3212441 A  ERRORERROR'
2019-01-21 00:53:32 [DEBUG   ] Got command RPT from MCS: ref #1233689
2019-01-21 00:53:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233689  77 58504  3212633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:53:32 [DEBUG   ] Got command RPT from MCS: ref #1233690
2019-01-21 00:53:32 [DEBUG   ] summary = ERROR
2019-01-21 00:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233690  13 58504  3212837 A  ERRORERROR'
2019-01-21 00:53:33 [DEBUG   ] Got command RPT from MCS: ref #1233691
2019-01-21 00:53:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233691  77 58504  3213041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:53:33 [DEBUG   ] Got command RPT from MCS: ref #1233692
2019-01-21 00:53:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 00:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233692  12 58504  3213245 A  ERRORB™™š'
2019-01-21 00:53:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 00:53:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:53:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-21 00:53:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-21 00:53:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:53:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:53:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:53:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:53:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:53:43 [DEBUG   ] Finished updating board flags in 1.780 seconds
2019-01-21 00:53:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 00:54:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 00:54:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 00:54:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:54:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:54:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:54:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:54:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:54:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:54:43 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-21 00:54:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 00:55:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 00:55:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 00:55:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:55:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:55:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:55:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:55:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:55:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:55:43 [DEBUG   ] Finished updating board flags in 1.580 seconds
2019-01-21 00:55:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 00:56:06 [DEBUG   ] Got command RPT from MCS: ref #1233697
2019-01-21 00:56:06 [DEBUG   ] summary = ERROR
2019-01-21 00:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233697  13 58504  3366809 A  ERRORERROR'
2019-01-21 00:56:06 [DEBUG   ] Got command RPT from MCS: ref #1233698
2019-01-21 00:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233698  77 58504  3366810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:56:12 [DEBUG   ] Got command TBW from MCS: ref #1233715
2019-01-21 00:56:12 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-21 00:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1233715   8 58504  3372073 A  ERROR'
2019-01-21 00:56:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-21 00:56:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-21 00:56:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-21 00:56:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-21 00:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-21 00:56:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-21 00:56:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-21 00:56:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-21 00:56:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-21 00:56:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-21 00:56:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-21 00:56:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-21 00:56:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-21 00:56:15 [DEBUG   ] spawn_process: at 2019-01-21 00:56:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-21 00:56:15 [INFO    ] Finished spawning TBW
2019-01-21 00:56:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-21 00:56:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:56:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:56:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:56:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:56:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:56:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:56:43 [DEBUG   ] Finished updating board flags in 1.350 seconds
2019-01-21 00:57:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 00:57:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:57:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:57:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:57:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:57:43 [WARNING ] (13, 1, 'bot')
2019-01-21 00:57:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:57:43 [DEBUG   ] Finished updating board flags in 1.283 seconds
2019-01-21 00:58:03 [INFO    ] __waitForTBW - TBW finished in 108.254 s
2019-01-21 00:58:04 [DEBUG   ] Finished updating ant stats in 0.426 seconds
2019-01-21 00:58:04 [INFO    ] Started antennas statistics background thread
2019-01-21 00:58:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1548032286']
2019-01-21 00:58:04 [DEBUG   ] spawn_process: at 2019-01-21 00:58:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1548032286']
2019-01-21 00:58:04 [INFO    ] Finished spawning TBN in 0.051 s
2019-01-21 00:58:24 [DEBUG   ] Finished updating ant stats in 0.466 seconds
2019-01-21 00:58:32 [DEBUG   ] Got command RPT from MCS: ref #1233723
2019-01-21 00:58:32 [DEBUG   ] summary = ERROR
2019-01-21 00:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233723  13 58504  3512525 A  ERRORERROR'
2019-01-21 00:58:32 [DEBUG   ] Got command RPT from MCS: ref #1233724
2019-01-21 00:58:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233724  77 58504  3512717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:58:32 [DEBUG   ] Got command RPT from MCS: ref #1233725
2019-01-21 00:58:32 [DEBUG   ] summary = ERROR
2019-01-21 00:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233725  13 58504  3512921 A  ERRORERROR'
2019-01-21 00:58:33 [DEBUG   ] Got command RPT from MCS: ref #1233727
2019-01-21 00:58:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 00:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233727  77 58504  3513125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 00:58:33 [DEBUG   ] Got command RPT from MCS: ref #1233728
2019-01-21 00:58:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 00:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233728  12 58504  3513329 A  ERRORB™™š'
2019-01-21 00:58:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 00:58:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 00:58:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:58:44 [WARNING ] (13, 1, 'bot')
2019-01-21 00:58:44 [WARNING ] (13, 1, 'bot')
2019-01-21 00:58:44 [WARNING ] (13, 1, 'bot')
2019-01-21 00:58:44 [WARNING ] (13, 1, 'bot')
2019-01-21 00:58:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:58:44 [DEBUG   ] Finished updating board flags in 2.242 seconds
2019-01-21 00:58:45 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 00:59:05 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 00:59:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 00:59:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 00:59:44 [WARNING ] (13, 1, 'bot')
2019-01-21 00:59:44 [WARNING ] (13, 1, 'bot')
2019-01-21 00:59:44 [WARNING ] (13, 1, 'bot')
2019-01-21 00:59:44 [WARNING ] (13, 1, 'bot')
2019-01-21 00:59:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 00:59:44 [DEBUG   ] Finished updating board flags in 2.196 seconds
2019-01-21 00:59:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 01:00:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 01:00:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 01:00:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:00:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:00:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:00:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:00:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:00:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:00:44 [DEBUG   ] Finished updating board flags in 2.035 seconds
2019-01-21 01:00:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:01:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:01:06 [DEBUG   ] Got command RPT from MCS: ref #1233739
2019-01-21 01:01:06 [DEBUG   ] summary = ERROR
2019-01-21 01:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233739  13 58504  3666813 A  ERRORERROR'
2019-01-21 01:01:06 [DEBUG   ] Got command RPT from MCS: ref #1233740
2019-01-21 01:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233740  77 58504  3666814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:01:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 01:01:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:01:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:01:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:01:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:01:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:01:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:01:44 [DEBUG   ] Finished updating board flags in 2.045 seconds
2019-01-21 01:01:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 01:02:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:02:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:02:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 01:02:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:02:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:02:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:02:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:02:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:02:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:02:44 [DEBUG   ] Finished updating board flags in 1.907 seconds
2019-01-21 01:02:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 01:03:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:03:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:03:32 [DEBUG   ] Got command RPT from MCS: ref #1233760
2019-01-21 01:03:32 [DEBUG   ] summary = ERROR
2019-01-21 01:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233760  13 58504  3812609 A  ERRORERROR'
2019-01-21 01:03:32 [DEBUG   ] Got command RPT from MCS: ref #1233761
2019-01-21 01:03:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233761  77 58504  3812813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:03:33 [DEBUG   ] Got command RPT from MCS: ref #1233762
2019-01-21 01:03:33 [DEBUG   ] summary = ERROR
2019-01-21 01:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233762  13 58504  3813005 A  ERRORERROR'
2019-01-21 01:03:33 [DEBUG   ] Got command RPT from MCS: ref #1233763
2019-01-21 01:03:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233763  77 58504  3813209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:03:33 [DEBUG   ] Got command RPT from MCS: ref #1233764
2019-01-21 01:03:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 01:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233764  12 58504  3813413 A  ERRORB˜™š'
2019-01-21 01:03:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:03:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:03:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:03:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:03:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:03:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:03:44 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-21 01:03:45 [DEBUG   ] Finished updating ant stats in 0.781 seconds
2019-01-21 01:04:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 01:04:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:04:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 01:04:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:04:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:04:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:04:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:04:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:04:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:04:44 [DEBUG   ] Finished updating board flags in 1.759 seconds
2019-01-21 01:04:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:05:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:05:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:05:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:05:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:05:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:05:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:05:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:05:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:05:44 [DEBUG   ] Finished updating board flags in 1.601 seconds
2019-01-21 01:05:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:06:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:06:06 [DEBUG   ] Got command RPT from MCS: ref #1233769
2019-01-21 01:06:06 [DEBUG   ] summary = ERROR
2019-01-21 01:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233769  13 58504  3966813 A  ERRORERROR'
2019-01-21 01:06:06 [DEBUG   ] Got command RPT from MCS: ref #1233770
2019-01-21 01:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233770  77 58504  3966814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:06:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:06:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-21 01:06:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:06:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:06:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:06:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:06:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:06:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:06:44 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-21 01:06:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 01:07:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:07:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:07:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:07:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:07:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:07:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:07:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:07:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:07:44 [DEBUG   ] Finished updating board flags in 1.571 seconds
2019-01-21 01:07:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:08:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 01:08:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:08:32 [DEBUG   ] Got command RPT from MCS: ref #1233792
2019-01-21 01:08:32 [DEBUG   ] summary = ERROR
2019-01-21 01:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233792  13 58504  4112697 A  ERRORERROR'
2019-01-21 01:08:32 [DEBUG   ] Got command RPT from MCS: ref #1233793
2019-01-21 01:08:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233793  77 58504  4112901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:08:33 [DEBUG   ] Got command RPT from MCS: ref #1233794
2019-01-21 01:08:33 [DEBUG   ] summary = ERROR
2019-01-21 01:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233794  13 58504  4113093 A  ERRORERROR'
2019-01-21 01:08:33 [DEBUG   ] Got command RPT from MCS: ref #1233796
2019-01-21 01:08:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233796  77 58504  4113297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:08:33 [DEBUG   ] Got command RPT from MCS: ref #1233798
2019-01-21 01:08:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 01:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233798  12 58504  4113501 A  ERRORB˜™š'
2019-01-21 01:08:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:08:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:08:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:08:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:08:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:08:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:08:44 [DEBUG   ] Finished updating board flags in 1.455 seconds
2019-01-21 01:08:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:09:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:09:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 01:09:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:09:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:09:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:09:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:09:44 [WARNING ] (13, 1, 'bot')
2019-01-21 01:09:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:09:44 [DEBUG   ] Finished updating board flags in 1.546 seconds
2019-01-21 01:09:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 01:10:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 01:10:26 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 01:10:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:10:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:10:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:10:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:10:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:10:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:10:45 [DEBUG   ] Finished updating board flags in 2.265 seconds
2019-01-21 01:10:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 01:11:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 01:11:06 [DEBUG   ] Got command RPT from MCS: ref #1233809
2019-01-21 01:11:06 [DEBUG   ] summary = ERROR
2019-01-21 01:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233809  13 58504  4266817 A  ERRORERROR'
2019-01-21 01:11:06 [DEBUG   ] Got command RPT from MCS: ref #1233810
2019-01-21 01:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233810  77 58504  4266818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:11:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 01:11:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:11:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-21 01:11:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-21 01:11:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:11:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:11:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:11:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:11:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:11:45 [DEBUG   ] Finished updating board flags in 2.252 seconds
2019-01-21 01:11:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 01:12:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 01:12:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 01:12:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:12:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-21 01:12:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:12:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:12:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:12:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:12:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:12:45 [DEBUG   ] Finished updating board flags in 2.125 seconds
2019-01-21 01:12:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 01:13:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 01:13:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 01:13:32 [DEBUG   ] Got command RPT from MCS: ref #1233833
2019-01-21 01:13:32 [DEBUG   ] summary = ERROR
2019-01-21 01:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233833  13 58504  4412789 A  ERRORERROR'
2019-01-21 01:13:32 [DEBUG   ] Got command RPT from MCS: ref #1233834
2019-01-21 01:13:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233834  77 58504  4412981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:13:33 [DEBUG   ] Got command RPT from MCS: ref #1233835
2019-01-21 01:13:33 [DEBUG   ] summary = ERROR
2019-01-21 01:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233835  13 58504  4413185 A  ERRORERROR'
2019-01-21 01:13:33 [DEBUG   ] Got command RPT from MCS: ref #1233836
2019-01-21 01:13:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233836  77 58504  4413389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:13:33 [DEBUG   ] Got command RPT from MCS: ref #1233837
2019-01-21 01:13:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 01:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233837  12 58504  4413581 A  ERRORB™™š'
2019-01-21 01:13:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 01:13:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:13:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:13:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:13:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:13:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:13:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:13:45 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-01-21 01:13:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 01:14:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 01:14:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 01:14:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 01:14:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:14:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:14:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:14:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:14:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:14:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:14:45 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-01-21 01:14:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 01:15:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:15:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 01:15:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:15:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-21 01:15:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:15:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:15:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:15:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:15:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:15:45 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-21 01:15:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 01:16:06 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-21 01:16:06 [DEBUG   ] Got command RPT from MCS: ref #1233842
2019-01-21 01:16:06 [DEBUG   ] summary = ERROR
2019-01-21 01:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233842  13 58504  4566817 A  ERRORERROR'
2019-01-21 01:16:06 [DEBUG   ] Got command RPT from MCS: ref #1233843
2019-01-21 01:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233843  77 58504  4566818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:16:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:16:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:16:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:16:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:16:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:16:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:16:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:16:45 [DEBUG   ] Finished updating board flags in 1.780 seconds
2019-01-21 01:16:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 01:17:06 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-21 01:17:27 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 01:17:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:17:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 01:17:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:17:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:17:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:17:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:17:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:17:45 [DEBUG   ] Finished updating board flags in 1.572 seconds
2019-01-21 01:17:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 01:18:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 01:18:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:18:32 [DEBUG   ] Got command RPT from MCS: ref #1233865
2019-01-21 01:18:32 [DEBUG   ] summary = ERROR
2019-01-21 01:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233865  13 58504  4712861 A  ERRORERROR'
2019-01-21 01:18:33 [DEBUG   ] Got command RPT from MCS: ref #1233866
2019-01-21 01:18:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233866  77 58504  4713065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:18:33 [DEBUG   ] Got command RPT from MCS: ref #1233867
2019-01-21 01:18:33 [DEBUG   ] summary = ERROR
2019-01-21 01:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233867  13 58504  4713269 A  ERRORERROR'
2019-01-21 01:18:33 [DEBUG   ] Got command RPT from MCS: ref #1233869
2019-01-21 01:18:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233869  77 58504  4713473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:18:33 [DEBUG   ] Got command RPT from MCS: ref #1233871
2019-01-21 01:18:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 01:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233871  12 58504  4713665 A  ERRORB˜™š'
2019-01-21 01:18:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:18:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:18:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:18:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:18:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:18:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:18:45 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-21 01:18:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:19:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 01:19:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 01:19:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:19:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:19:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:19:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:19:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:19:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:19:45 [DEBUG   ] Finished updating board flags in 1.445 seconds
2019-01-21 01:19:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 01:20:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:20:27 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-01-21 01:20:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:20:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:20:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:20:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:20:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:20:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:20:45 [DEBUG   ] Finished updating board flags in 1.428 seconds
2019-01-21 01:20:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 01:21:06 [DEBUG   ] Got command RPT from MCS: ref #1233879
2019-01-21 01:21:06 [DEBUG   ] summary = ERROR
2019-01-21 01:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233879  13 58504  4866813 A  ERRORERROR'
2019-01-21 01:21:06 [DEBUG   ] Got command RPT from MCS: ref #1233880
2019-01-21 01:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233880  77 58504  4866814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:21:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 01:21:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 01:21:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:21:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:21:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:21:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:21:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:21:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:21:45 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-01-21 01:21:48 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 01:22:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 01:22:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 01:22:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:22:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:22:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:22:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:22:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:22:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:22:45 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-01-21 01:22:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 01:23:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 01:23:28 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 01:23:32 [DEBUG   ] Got command RPT from MCS: ref #1233900
2019-01-21 01:23:32 [DEBUG   ] summary = ERROR
2019-01-21 01:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233900  13 58504  5012953 A  ERRORERROR'
2019-01-21 01:23:33 [DEBUG   ] Got command RPT from MCS: ref #1233901
2019-01-21 01:23:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233901  77 58504  5013157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:23:33 [DEBUG   ] Got command RPT from MCS: ref #1233902
2019-01-21 01:23:33 [DEBUG   ] summary = ERROR
2019-01-21 01:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233902  13 58504  5013349 A  ERRORERROR'
2019-01-21 01:23:33 [DEBUG   ] Got command RPT from MCS: ref #1233903
2019-01-21 01:23:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233903  77 58504  5013553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:23:33 [DEBUG   ] Got command RPT from MCS: ref #1233904
2019-01-21 01:23:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 01:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233904  12 58504  5013757 A  ERRORB˜™š'
2019-01-21 01:23:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 01:23:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:23:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:23:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:23:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:23:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:23:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:23:45 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-01-21 01:23:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 01:24:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 01:24:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 01:24:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 01:24:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:24:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:24:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:24:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:24:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:24:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:24:45 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-01-21 01:24:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 01:25:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 01:25:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 01:25:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:25:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:25:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:25:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:25:45 [WARNING ] (13, 1, 'bot')
2019-01-21 01:25:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:25:45 [DEBUG   ] Finished updating board flags in 1.512 seconds
2019-01-21 01:25:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:26:06 [DEBUG   ] Got command RPT from MCS: ref #1233909
2019-01-21 01:26:06 [DEBUG   ] summary = ERROR
2019-01-21 01:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233909  13 58504  5166817 A  ERRORERROR'
2019-01-21 01:26:06 [DEBUG   ] Got command RPT from MCS: ref #1233910
2019-01-21 01:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233910  77 58504  5166818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:26:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 01:26:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:26:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:26:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:26:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:26:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:26:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:26:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:26:46 [DEBUG   ] Finished updating board flags in 2.199 seconds
2019-01-21 01:26:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 01:27:08 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-21 01:27:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:27:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:27:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:27:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:27:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:27:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:27:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:27:46 [DEBUG   ] Finished updating board flags in 1.886 seconds
2019-01-21 01:27:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:28:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 01:28:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 01:28:33 [DEBUG   ] Got command RPT from MCS: ref #1233928
2019-01-21 01:28:33 [DEBUG   ] summary = ERROR
2019-01-21 01:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233928  13 58504  5313037 A  ERRORERROR'
2019-01-21 01:28:33 [DEBUG   ] Got command RPT from MCS: ref #1233929
2019-01-21 01:28:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233929  77 58504  5313241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:28:33 [DEBUG   ] Got command RPT from MCS: ref #1233930
2019-01-21 01:28:33 [DEBUG   ] summary = ERROR
2019-01-21 01:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233930  13 58504  5313433 A  ERRORERROR'
2019-01-21 01:28:33 [DEBUG   ] Got command RPT from MCS: ref #1233932
2019-01-21 01:28:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233932  77 58504  5313637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:28:33 [DEBUG   ] Got command RPT from MCS: ref #1233934
2019-01-21 01:28:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 01:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233934  12 58504  5313841 A  ERRORB˜™š'
2019-01-21 01:28:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 01:28:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:28:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:28:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:28:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:28:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:28:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:28:46 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-21 01:28:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 01:29:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:29:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:29:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 01:29:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:29:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:29:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:29:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:29:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:29:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:29:46 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-21 01:29:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:30:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 01:30:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:30:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:30:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 01:30:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:30:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:30:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:30:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:30:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:30:46 [DEBUG   ] Finished updating board flags in 1.779 seconds
2019-01-21 01:30:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 01:31:06 [DEBUG   ] Got command RPT from MCS: ref #1233942
2019-01-21 01:31:06 [DEBUG   ] summary = ERROR
2019-01-21 01:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233942  13 58504  5466821 A  ERRORERROR'
2019-01-21 01:31:06 [DEBUG   ] Got command RPT from MCS: ref #1233943
2019-01-21 01:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233943  77 58504  5466822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:31:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:31:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:31:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:31:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:31:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:31:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:31:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:31:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:31:46 [DEBUG   ] Finished updating board flags in 1.628 seconds
2019-01-21 01:31:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:32:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 01:32:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:32:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:32:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:32:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:32:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:32:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:32:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:32:46 [DEBUG   ] Finished updating board flags in 1.683 seconds
2019-01-21 01:32:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 01:33:08 [DEBUG   ] Finished updating ant stats in 0.590 seconds
2019-01-21 01:33:28 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-21 01:33:33 [DEBUG   ] Got command RPT from MCS: ref #1233963
2019-01-21 01:33:33 [DEBUG   ] summary = ERROR
2019-01-21 01:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233963  13 58504  5613125 A  ERRORERROR'
2019-01-21 01:33:33 [DEBUG   ] Got command RPT from MCS: ref #1233964
2019-01-21 01:33:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233964  77 58504  5613329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:33:33 [DEBUG   ] Got command RPT from MCS: ref #1233965
2019-01-21 01:33:33 [DEBUG   ] summary = ERROR
2019-01-21 01:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233965  13 58504  5613521 A  ERRORERROR'
2019-01-21 01:33:33 [DEBUG   ] Got command RPT from MCS: ref #1233966
2019-01-21 01:33:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233966  77 58504  5613725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:33:33 [DEBUG   ] Got command RPT from MCS: ref #1233967
2019-01-21 01:33:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 01:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233967  12 58504  5613929 A  ERRORB–™š'
2019-01-21 01:33:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:33:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:33:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:33:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:33:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:33:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:33:46 [DEBUG   ] Finished updating board flags in 1.497 seconds
2019-01-21 01:33:49 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-21 01:34:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 01:34:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 01:34:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:34:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:34:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:34:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:34:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:34:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:34:46 [DEBUG   ] Finished updating board flags in 1.456 seconds
2019-01-21 01:34:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 01:35:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 01:35:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 01:35:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:35:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:35:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:35:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:35:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:35:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:35:46 [DEBUG   ] Finished updating board flags in 1.480 seconds
2019-01-21 01:35:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 01:36:06 [DEBUG   ] Got command RPT from MCS: ref #1233972
2019-01-21 01:36:06 [DEBUG   ] summary = ERROR
2019-01-21 01:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233972  13 58504  5766821 A  ERRORERROR'
2019-01-21 01:36:06 [DEBUG   ] Got command RPT from MCS: ref #1233973
2019-01-21 01:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233973  77 58504  5766822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:36:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 01:36:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 01:36:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 01:36:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:36:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:36:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:36:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:36:46 [WARNING ] (13, 1, 'bot')
2019-01-21 01:36:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:36:46 [DEBUG   ] Finished updating board flags in 1.506 seconds
2019-01-21 01:36:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 01:37:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 01:37:29 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 01:37:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:37:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:37:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:37:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:37:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:37:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:37:47 [DEBUG   ] Finished updating board flags in 2.212 seconds
2019-01-21 01:37:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:38:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:38:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 01:38:33 [DEBUG   ] Got command RPT from MCS: ref #1233995
2019-01-21 01:38:33 [DEBUG   ] summary = ERROR
2019-01-21 01:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233995  13 58504  5913209 A  ERRORERROR'
2019-01-21 01:38:33 [DEBUG   ] Got command RPT from MCS: ref #1233996
2019-01-21 01:38:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233996  77 58504  5913413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:38:33 [DEBUG   ] Got command RPT from MCS: ref #1233997
2019-01-21 01:38:33 [DEBUG   ] summary = ERROR
2019-01-21 01:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233997  13 58504  5913617 A  ERRORERROR'
2019-01-21 01:38:33 [DEBUG   ] Got command RPT from MCS: ref #1233999
2019-01-21 01:38:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1233999  77 58504  5913809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:38:34 [DEBUG   ] Got command RPT from MCS: ref #1234000
2019-01-21 01:38:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 01:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234000  12 58504  5914013 A  ERRORB—™š'
2019-01-21 01:38:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:38:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:38:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:38:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:38:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:38:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:38:47 [DEBUG   ] Finished updating board flags in 2.166 seconds
2019-01-21 01:38:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 01:39:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:39:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:39:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:39:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:39:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:39:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:39:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:39:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:39:47 [DEBUG   ] Finished updating board flags in 2.095 seconds
2019-01-21 01:39:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 01:40:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 01:40:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:40:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:40:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:40:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:40:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:40:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:40:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:40:47 [DEBUG   ] Finished updating board flags in 1.910 seconds
2019-01-21 01:40:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:41:06 [DEBUG   ] Got command RPT from MCS: ref #1234009
2019-01-21 01:41:06 [DEBUG   ] summary = ERROR
2019-01-21 01:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234009  13 58504  6066821 A  ERRORERROR'
2019-01-21 01:41:06 [DEBUG   ] Got command RPT from MCS: ref #1234010
2019-01-21 01:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234010  77 58504  6066822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:41:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 01:41:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 01:41:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:41:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:41:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:41:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:41:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:41:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:41:47 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-01-21 01:41:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:42:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:42:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 01:42:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:42:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:42:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:42:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:42:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:42:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:42:47 [DEBUG   ] Finished updating board flags in 1.772 seconds
2019-01-21 01:42:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 01:43:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:43:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:43:33 [DEBUG   ] Got command RPT from MCS: ref #1234026
2019-01-21 01:43:33 [DEBUG   ] summary = ERROR
2019-01-21 01:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234026  13 58504  6213297 A  ERRORERROR'
2019-01-21 01:43:33 [DEBUG   ] Got command RPT from MCS: ref #1234027
2019-01-21 01:43:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234027  77 58504  6213501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:43:33 [DEBUG   ] Got command RPT from MCS: ref #1234028
2019-01-21 01:43:33 [DEBUG   ] summary = ERROR
2019-01-21 01:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234028  13 58504  6213705 A  ERRORERROR'
2019-01-21 01:43:33 [DEBUG   ] Got command RPT from MCS: ref #1234029
2019-01-21 01:43:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234029  77 58504  6213897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:43:34 [DEBUG   ] Got command RPT from MCS: ref #1234030
2019-01-21 01:43:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 01:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234030  12 58504  6214101 A  ERRORB˜™š'
2019-01-21 01:43:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:43:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 01:43:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:43:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:43:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:43:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:43:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:43:47 [DEBUG   ] Finished updating board flags in 1.639 seconds
2019-01-21 01:43:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 01:44:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 01:44:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:44:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:44:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:44:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:44:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:44:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:44:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:44:47 [DEBUG   ] Finished updating board flags in 1.560 seconds
2019-01-21 01:44:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:45:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 01:45:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:45:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:45:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:45:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:45:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:45:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:45:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:45:47 [DEBUG   ] Finished updating board flags in 1.469 seconds
2019-01-21 01:45:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:46:06 [DEBUG   ] Got command RPT from MCS: ref #1234035
2019-01-21 01:46:06 [DEBUG   ] summary = ERROR
2019-01-21 01:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234035  13 58504  6366825 A  ERRORERROR'
2019-01-21 01:46:06 [DEBUG   ] Got command RPT from MCS: ref #1234036
2019-01-21 01:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234036  77 58504  6366826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:46:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:46:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 01:46:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:46:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:46:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:46:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:46:47 [WARNING ] (13, 1, 'bot')
2019-01-21 01:46:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:46:47 [DEBUG   ] Finished updating board flags in 1.557 seconds
2019-01-21 01:46:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 01:47:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 01:47:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 01:47:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:47:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 01:47:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:47:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:47:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:47:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:47:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:47:48 [DEBUG   ] Finished updating board flags in 2.273 seconds
2019-01-21 01:47:49 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-21 01:48:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 01:48:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 01:48:33 [DEBUG   ] Got command RPT from MCS: ref #1234058
2019-01-21 01:48:33 [DEBUG   ] summary = ERROR
2019-01-21 01:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234058  13 58504  6513385 A  ERRORERROR'
2019-01-21 01:48:33 [DEBUG   ] Got command RPT from MCS: ref #1234059
2019-01-21 01:48:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234059  77 58504  6513589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:48:33 [DEBUG   ] Got command RPT from MCS: ref #1234060
2019-01-21 01:48:33 [DEBUG   ] summary = ERROR
2019-01-21 01:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234060  13 58504  6513781 A  ERRORERROR'
2019-01-21 01:48:33 [DEBUG   ] Got command RPT from MCS: ref #1234062
2019-01-21 01:48:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234062  77 58504  6513985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:48:34 [DEBUG   ] Got command RPT from MCS: ref #1234063
2019-01-21 01:48:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 01:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234063  12 58504  6514189 A  ERRORB—™š'
2019-01-21 01:48:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:48:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:48:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:48:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:48:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:48:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:48:48 [DEBUG   ] Finished updating board flags in 2.105 seconds
2019-01-21 01:48:50 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 01:49:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 01:49:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 01:49:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:49:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:49:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:49:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:49:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:49:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:49:48 [DEBUG   ] Finished updating board flags in 2.008 seconds
2019-01-21 01:49:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 01:50:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 01:50:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:50:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:50:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:50:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:50:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:50:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:50:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:50:48 [DEBUG   ] Finished updating board flags in 1.996 seconds
2019-01-21 01:50:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:51:06 [DEBUG   ] Got command RPT from MCS: ref #1234072
2019-01-21 01:51:06 [DEBUG   ] summary = ERROR
2019-01-21 01:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234072  13 58504  6666821 A  ERRORERROR'
2019-01-21 01:51:06 [DEBUG   ] Got command RPT from MCS: ref #1234073
2019-01-21 01:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234073  77 58504  6666822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:51:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 01:51:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 01:51:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:51:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:51:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:51:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:51:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:51:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:51:48 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-01-21 01:51:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 01:52:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 01:52:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 01:52:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:52:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:52:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:52:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:52:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:52:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:52:48 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-01-21 01:52:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 01:53:10 [DEBUG   ] Finished updating ant stats in 0.986 seconds
2019-01-21 01:53:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 01:53:33 [DEBUG   ] Got command RPT from MCS: ref #1234093
2019-01-21 01:53:33 [DEBUG   ] summary = ERROR
2019-01-21 01:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234093  13 58504  6813469 A  ERRORERROR'
2019-01-21 01:53:33 [DEBUG   ] Got command RPT from MCS: ref #1234094
2019-01-21 01:53:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234094  77 58504  6813673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:53:33 [DEBUG   ] Got command RPT from MCS: ref #1234095
2019-01-21 01:53:33 [DEBUG   ] summary = ERROR
2019-01-21 01:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234095  13 58504  6813865 A  ERRORERROR'
2019-01-21 01:53:34 [DEBUG   ] Got command RPT from MCS: ref #1234096
2019-01-21 01:53:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234096  77 58504  6814069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:53:34 [DEBUG   ] Got command RPT from MCS: ref #1234097
2019-01-21 01:53:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 01:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234097  12 58504  6814273 A  ERRORB•™š'
2019-01-21 01:53:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:53:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:53:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:53:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:53:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:53:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:53:48 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-21 01:53:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 01:54:10 [DEBUG   ] Finished updating ant stats in 0.776 seconds
2019-01-21 01:54:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 01:54:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:54:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:54:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:54:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:54:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:54:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:54:48 [DEBUG   ] Finished updating board flags in 1.767 seconds
2019-01-21 01:54:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:55:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:55:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:55:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:55:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:55:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:55:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:55:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:55:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:55:48 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-21 01:55:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:56:06 [DEBUG   ] Got command RPT from MCS: ref #1234102
2019-01-21 01:56:06 [DEBUG   ] summary = ERROR
2019-01-21 01:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234102  13 58504  6966833 A  ERRORERROR'
2019-01-21 01:56:06 [DEBUG   ] Got command RPT from MCS: ref #1234103
2019-01-21 01:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234103  77 58504  6966834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:56:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 01:56:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 01:56:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 01:56:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:56:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:56:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:56:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:56:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:56:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:56:48 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-01-21 01:56:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 01:57:10 [DEBUG   ] Finished updating ant stats in 0.578 seconds
2019-01-21 01:57:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 01:57:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:57:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:57:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:57:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:57:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:57:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:57:48 [DEBUG   ] Finished updating board flags in 1.400 seconds
2019-01-21 01:57:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 01:58:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 01:58:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 01:58:33 [DEBUG   ] Got command RPT from MCS: ref #1234121
2019-01-21 01:58:33 [DEBUG   ] summary = ERROR
2019-01-21 01:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234121  13 58504  7113557 A  ERRORERROR'
2019-01-21 01:58:33 [DEBUG   ] Got command RPT from MCS: ref #1234122
2019-01-21 01:58:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234122  77 58504  7113761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:58:33 [DEBUG   ] Got command RPT from MCS: ref #1234123
2019-01-21 01:58:33 [DEBUG   ] summary = ERROR
2019-01-21 01:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234123  13 58504  7113953 A  ERRORERROR'
2019-01-21 01:58:34 [DEBUG   ] Got command RPT from MCS: ref #1234125
2019-01-21 01:58:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 01:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234125  77 58504  7114157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 01:58:34 [DEBUG   ] Got command RPT from MCS: ref #1234126
2019-01-21 01:58:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 01:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234126  12 58504  7114361 A  ERRORB˜™š'
2019-01-21 01:58:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:58:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:58:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:58:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:58:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:58:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:58:48 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-21 01:58:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 01:59:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 01:59:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 01:59:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 01:59:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:59:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:59:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:59:48 [WARNING ] (13, 1, 'bot')
2019-01-21 01:59:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 01:59:48 [DEBUG   ] Finished updating board flags in 1.527 seconds
2019-01-21 01:59:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 02:00:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 02:00:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 02:00:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:00:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 02:00:48 [WARNING ] (13, 1, 'bot')
2019-01-21 02:00:48 [WARNING ] (13, 1, 'bot')
2019-01-21 02:00:48 [WARNING ] (13, 1, 'bot')
2019-01-21 02:00:48 [WARNING ] (13, 1, 'bot')
2019-01-21 02:00:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:00:48 [DEBUG   ] Finished updating board flags in 1.563 seconds
2019-01-21 02:00:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 02:01:06 [DEBUG   ] Got command RPT from MCS: ref #1234135
2019-01-21 02:01:06 [DEBUG   ] summary = ERROR
2019-01-21 02:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234135  13 58504  7266829 A  ERRORERROR'
2019-01-21 02:01:06 [DEBUG   ] Got command RPT from MCS: ref #1234136
2019-01-21 02:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234136  77 58504  7266830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:01:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 02:01:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 02:01:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:01:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:01:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:01:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:01:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:01:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:01:49 [DEBUG   ] Finished updating board flags in 2.229 seconds
2019-01-21 02:01:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 02:02:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 02:02:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 02:02:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:02:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:02:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:02:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:02:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:02:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:02:49 [DEBUG   ] Finished updating board flags in 2.077 seconds
2019-01-21 02:02:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 02:03:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 02:03:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 02:03:33 [DEBUG   ] Got command RPT from MCS: ref #1234156
2019-01-21 02:03:33 [DEBUG   ] summary = ERROR
2019-01-21 02:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234156  13 58504  7413641 A  ERRORERROR'
2019-01-21 02:03:33 [DEBUG   ] Got command RPT from MCS: ref #1234157
2019-01-21 02:03:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234157  77 58504  7413845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:03:34 [DEBUG   ] Got command RPT from MCS: ref #1234158
2019-01-21 02:03:34 [DEBUG   ] summary = ERROR
2019-01-21 02:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234158  13 58504  7414049 A  ERRORERROR'
2019-01-21 02:03:34 [DEBUG   ] Got command RPT from MCS: ref #1234159
2019-01-21 02:03:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234159  77 58504  7414241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:03:34 [DEBUG   ] Got command RPT from MCS: ref #1234160
2019-01-21 02:03:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 02:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234160  12 58504  7414445 A  ERRORB—™š'
2019-01-21 02:03:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:03:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:03:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:03:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:03:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:03:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:03:49 [DEBUG   ] Finished updating board flags in 2.023 seconds
2019-01-21 02:03:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 02:04:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 02:04:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 02:04:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:04:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:04:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:04:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:04:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:04:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:04:49 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-21 02:04:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:05:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:05:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 02:05:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:05:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:05:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:05:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:05:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:05:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:05:49 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-21 02:05:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:06:06 [DEBUG   ] Got command RPT from MCS: ref #1234165
2019-01-21 02:06:06 [DEBUG   ] summary = ERROR
2019-01-21 02:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234165  13 58504  7566833 A  ERRORERROR'
2019-01-21 02:06:06 [DEBUG   ] Got command RPT from MCS: ref #1234166
2019-01-21 02:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234166  77 58504  7566834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:06:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 02:06:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:06:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:06:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 02:06:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:06:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:06:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:06:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:06:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:06:49 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-21 02:06:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 02:07:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:07:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 02:07:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:07:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:07:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:07:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:07:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:07:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:07:49 [DEBUG   ] Finished updating board flags in 1.862 seconds
2019-01-21 02:07:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:08:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 02:08:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 02:08:33 [DEBUG   ] Got command RPT from MCS: ref #1234188
2019-01-21 02:08:33 [DEBUG   ] summary = ERROR
2019-01-21 02:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234188  13 58504  7713729 A  ERRORERROR'
2019-01-21 02:08:33 [DEBUG   ] Got command RPT from MCS: ref #1234189
2019-01-21 02:08:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234189  77 58504  7713933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:08:34 [DEBUG   ] Got command RPT from MCS: ref #1234190
2019-01-21 02:08:34 [DEBUG   ] summary = ERROR
2019-01-21 02:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234190  13 58504  7714125 A  ERRORERROR'
2019-01-21 02:08:34 [DEBUG   ] Got command RPT from MCS: ref #1234192
2019-01-21 02:08:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234192  77 58504  7714329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:08:34 [DEBUG   ] Got command RPT from MCS: ref #1234194
2019-01-21 02:08:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 02:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234194  12 58504  7714533 A  ERRORB•™š'
2019-01-21 02:08:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:08:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:08:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:08:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:08:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:08:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:08:49 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-01-21 02:08:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:09:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:09:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 02:09:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:09:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:09:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:09:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:09:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:09:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:09:49 [DEBUG   ] Finished updating board flags in 1.541 seconds
2019-01-21 02:09:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:10:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 02:10:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 02:10:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:10:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:10:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:10:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:10:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:10:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:10:49 [DEBUG   ] Finished updating board flags in 1.481 seconds
2019-01-21 02:10:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 02:11:06 [DEBUG   ] Got command RPT from MCS: ref #1234202
2019-01-21 02:11:06 [DEBUG   ] summary = ERROR
2019-01-21 02:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234202  13 58504  7866829 A  ERRORERROR'
2019-01-21 02:11:06 [DEBUG   ] Got command RPT from MCS: ref #1234203
2019-01-21 02:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234203  77 58504  7866830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:11:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:11:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:11:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:11:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:11:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:11:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:11:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:11:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:11:49 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-01-21 02:11:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:12:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 02:12:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 02:12:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:12:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:12:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:12:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:12:49 [WARNING ] (13, 1, 'bot')
2019-01-21 02:12:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:12:49 [DEBUG   ] Finished updating board flags in 1.473 seconds
2019-01-21 02:12:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 02:13:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 02:13:32 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 02:13:33 [DEBUG   ] Got command RPT from MCS: ref #1234219
2019-01-21 02:13:33 [DEBUG   ] summary = ERROR
2019-01-21 02:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234219  13 58504  8013813 A  ERRORERROR'
2019-01-21 02:13:34 [DEBUG   ] Got command RPT from MCS: ref #1234220
2019-01-21 02:13:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234220  77 58504  8014017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:13:34 [DEBUG   ] Got command RPT from MCS: ref #1234221
2019-01-21 02:13:34 [DEBUG   ] summary = ERROR
2019-01-21 02:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234221  13 58504  8014221 A  ERRORERROR'
2019-01-21 02:13:34 [DEBUG   ] Got command RPT from MCS: ref #1234222
2019-01-21 02:13:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234222  77 58504  8014425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:13:34 [DEBUG   ] Got command RPT from MCS: ref #1234223
2019-01-21 02:13:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 02:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234223  12 58504  8014617 A  ERRORB–™š'
2019-01-21 02:13:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 02:13:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:13:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:13:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:13:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:13:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:13:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:13:50 [DEBUG   ] Finished updating board flags in 2.187 seconds
2019-01-21 02:13:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:14:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 02:14:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 02:14:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:14:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:14:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:14:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:14:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:14:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:14:50 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-01-21 02:14:52 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2019-01-21 02:15:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 02:15:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 02:15:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:15:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:15:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:15:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:15:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:15:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:15:50 [DEBUG   ] Finished updating board flags in 1.825 seconds
2019-01-21 02:15:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 02:16:06 [DEBUG   ] Got command RPT from MCS: ref #1234228
2019-01-21 02:16:06 [DEBUG   ] summary = ERROR
2019-01-21 02:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234228  13 58504  8166841 A  ERRORERROR'
2019-01-21 02:16:06 [DEBUG   ] Got command RPT from MCS: ref #1234229
2019-01-21 02:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234229  77 58504  8166842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:16:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 02:16:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 02:16:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:16:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:16:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:16:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:16:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:16:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:16:50 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-01-21 02:16:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 02:17:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 02:17:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 02:17:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:17:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:17:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:17:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:17:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:17:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:17:50 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-21 02:17:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 02:18:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 02:18:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 02:18:33 [DEBUG   ] Got command RPT from MCS: ref #1234251
2019-01-21 02:18:33 [DEBUG   ] summary = ERROR
2019-01-21 02:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234251  13 58504  8313905 A  ERRORERROR'
2019-01-21 02:18:34 [DEBUG   ] Got command RPT from MCS: ref #1234252
2019-01-21 02:18:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234252  77 58504  8314097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:18:34 [DEBUG   ] Got command RPT from MCS: ref #1234253
2019-01-21 02:18:34 [DEBUG   ] summary = ERROR
2019-01-21 02:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234253  13 58504  8314301 A  ERRORERROR'
2019-01-21 02:18:34 [DEBUG   ] Got command RPT from MCS: ref #1234255
2019-01-21 02:18:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234255  77 58504  8314505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:18:34 [DEBUG   ] Got command RPT from MCS: ref #1234257
2019-01-21 02:18:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 02:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234257  12 58504  8314709 A  ERRORB—™š'
2019-01-21 02:18:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 02:18:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:18:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:18:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:18:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:18:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:18:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:18:50 [DEBUG   ] Finished updating board flags in 1.756 seconds
2019-01-21 02:18:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 02:19:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 02:19:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 02:19:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:19:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:19:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:19:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:19:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:19:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:19:50 [DEBUG   ] Finished updating board flags in 1.634 seconds
2019-01-21 02:19:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 02:20:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 02:20:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:20:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:20:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:20:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:20:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:20:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:20:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:20:50 [DEBUG   ] Finished updating board flags in 1.572 seconds
2019-01-21 02:20:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 02:21:06 [DEBUG   ] Got command RPT from MCS: ref #1234265
2019-01-21 02:21:06 [DEBUG   ] summary = ERROR
2019-01-21 02:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234265  13 58504  8466833 A  ERRORERROR'
2019-01-21 02:21:06 [DEBUG   ] Got command RPT from MCS: ref #1234266
2019-01-21 02:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234266  77 58504  8466834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:21:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 02:21:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 02:21:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:21:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:21:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:21:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:21:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:21:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:21:50 [DEBUG   ] Finished updating board flags in 1.526 seconds
2019-01-21 02:21:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:22:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 02:22:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 02:22:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:22:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:22:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:22:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:22:50 [WARNING ] (13, 1, 'bot')
2019-01-21 02:22:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:22:50 [DEBUG   ] Finished updating board flags in 1.566 seconds
2019-01-21 02:22:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 02:23:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:23:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 02:23:33 [DEBUG   ] Got command RPT from MCS: ref #1234286
2019-01-21 02:23:33 [DEBUG   ] summary = ERROR
2019-01-21 02:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234286  13 58504  8613985 A  ERRORERROR'
2019-01-21 02:23:34 [DEBUG   ] Got command RPT from MCS: ref #1234287
2019-01-21 02:23:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234287  77 58504  8614189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:23:34 [DEBUG   ] Got command RPT from MCS: ref #1234288
2019-01-21 02:23:34 [DEBUG   ] summary = ERROR
2019-01-21 02:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234288  13 58504  8614393 A  ERRORERROR'
2019-01-21 02:23:34 [DEBUG   ] Got command RPT from MCS: ref #1234289
2019-01-21 02:23:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234289  77 58504  8614585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:23:34 [DEBUG   ] Got command RPT from MCS: ref #1234290
2019-01-21 02:23:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 02:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234290  12 58504  8614789 A  ERRORB–™š'
2019-01-21 02:23:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:23:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:23:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:23:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:23:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:23:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:23:51 [DEBUG   ] Finished updating board flags in 2.275 seconds
2019-01-21 02:23:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 02:24:13 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 02:24:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 02:24:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:24:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:24:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:24:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:24:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:24:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:24:51 [DEBUG   ] Finished updating board flags in 2.039 seconds
2019-01-21 02:24:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 02:25:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 02:25:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 02:25:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:25:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:25:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:25:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:25:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:25:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:25:51 [DEBUG   ] Finished updating board flags in 2.027 seconds
2019-01-21 02:25:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 02:26:06 [DEBUG   ] Got command RPT from MCS: ref #1234295
2019-01-21 02:26:06 [DEBUG   ] summary = ERROR
2019-01-21 02:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234295  13 58504  8766841 A  ERRORERROR'
2019-01-21 02:26:06 [DEBUG   ] Got command RPT from MCS: ref #1234296
2019-01-21 02:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234296  77 58504  8766842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:26:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 02:26:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 02:26:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:26:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 02:26:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:26:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:26:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:26:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:26:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:26:51 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-01-21 02:26:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 02:27:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:27:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 02:27:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:27:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:27:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:27:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:27:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:27:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:27:51 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-21 02:27:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 02:28:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:28:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:28:34 [DEBUG   ] Got command RPT from MCS: ref #1234314
2019-01-21 02:28:34 [DEBUG   ] summary = ERROR
2019-01-21 02:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234314  13 58504  8914069 A  ERRORERROR'
2019-01-21 02:28:34 [DEBUG   ] Got command RPT from MCS: ref #1234315
2019-01-21 02:28:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234315  77 58504  8914273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:28:34 [DEBUG   ] Got command RPT from MCS: ref #1234316
2019-01-21 02:28:34 [DEBUG   ] summary = ERROR
2019-01-21 02:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234316  13 58504  8914477 A  ERRORERROR'
2019-01-21 02:28:34 [DEBUG   ] Got command RPT from MCS: ref #1234318
2019-01-21 02:28:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234318  77 58504  8914669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:28:34 [DEBUG   ] Got command RPT from MCS: ref #1234319
2019-01-21 02:28:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 02:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234319  12 58504  8914873 A  ERRORB–™š'
2019-01-21 02:28:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 02:28:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:28:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:28:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:28:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:28:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:28:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:28:51 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-01-21 02:28:53 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-21 02:29:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 02:29:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:29:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:29:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:29:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:29:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:29:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:29:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:29:51 [DEBUG   ] Finished updating board flags in 1.598 seconds
2019-01-21 02:29:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:30:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 02:30:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 02:30:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 02:30:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:30:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:30:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:30:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:30:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:30:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:30:51 [DEBUG   ] Finished updating board flags in 1.521 seconds
2019-01-21 02:30:53 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-21 02:31:06 [DEBUG   ] Got command RPT from MCS: ref #1234328
2019-01-21 02:31:06 [DEBUG   ] summary = ERROR
2019-01-21 02:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234328  13 58504  9066845 A  ERRORERROR'
2019-01-21 02:31:06 [DEBUG   ] Got command RPT from MCS: ref #1234329
2019-01-21 02:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234329  77 58504  9066846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:31:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 02:31:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 02:31:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:31:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:31:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:31:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:31:51 [WARNING ] (13, 1, 'bot')
2019-01-21 02:31:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:31:51 [DEBUG   ] Finished updating board flags in 1.520 seconds
2019-01-21 02:31:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 02:32:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 02:32:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 02:32:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:32:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:32:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:32:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:32:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:32:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:32:52 [DEBUG   ] Finished updating board flags in 2.255 seconds
2019-01-21 02:32:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 02:33:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:33:34 [DEBUG   ] Got command RPT from MCS: ref #1234349
2019-01-21 02:33:34 [DEBUG   ] summary = ERROR
2019-01-21 02:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234349  13 58504  9214157 A  ERRORERROR'
2019-01-21 02:33:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 02:33:34 [DEBUG   ] Got command RPT from MCS: ref #1234350
2019-01-21 02:33:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234350  77 58504  9214361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:33:34 [DEBUG   ] Got command RPT from MCS: ref #1234351
2019-01-21 02:33:34 [DEBUG   ] summary = ERROR
2019-01-21 02:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234351  13 58504  9214565 A  ERRORERROR'
2019-01-21 02:33:34 [DEBUG   ] Got command RPT from MCS: ref #1234352
2019-01-21 02:33:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234352  77 58504  9214757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:33:34 [DEBUG   ] Got command RPT from MCS: ref #1234353
2019-01-21 02:33:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 02:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234353  12 58504  9214961 A  ERRORB—™š'
2019-01-21 02:33:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:33:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:33:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:33:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:33:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:33:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:33:52 [DEBUG   ] Finished updating board flags in 2.108 seconds
2019-01-21 02:33:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 02:34:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 02:34:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:34:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:34:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:34:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:34:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:34:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:34:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:34:52 [DEBUG   ] Finished updating board flags in 2.046 seconds
2019-01-21 02:34:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 02:35:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 02:35:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 02:35:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:35:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:35:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:35:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:35:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:35:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:35:52 [DEBUG   ] Finished updating board flags in 1.973 seconds
2019-01-21 02:35:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 02:36:06 [DEBUG   ] Got command RPT from MCS: ref #1234358
2019-01-21 02:36:06 [DEBUG   ] summary = ERROR
2019-01-21 02:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234358  13 58504  9366845 A  ERRORERROR'
2019-01-21 02:36:06 [DEBUG   ] Got command RPT from MCS: ref #1234359
2019-01-21 02:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234359  77 58504  9366846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:36:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 02:36:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 02:36:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:36:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:36:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:36:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:36:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:36:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:36:52 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-21 02:36:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 02:37:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 02:37:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 02:37:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 02:37:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:37:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:37:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:37:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:37:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:37:52 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-01-21 02:37:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 02:38:14 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-21 02:38:34 [DEBUG   ] Got command RPT from MCS: ref #1234381
2019-01-21 02:38:34 [DEBUG   ] summary = ERROR
2019-01-21 02:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234381  13 58504  9514249 A  ERRORERROR'
2019-01-21 02:38:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:38:34 [DEBUG   ] Got command RPT from MCS: ref #1234382
2019-01-21 02:38:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234382  77 58504  9514441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:38:34 [DEBUG   ] Got command RPT from MCS: ref #1234383
2019-01-21 02:38:34 [DEBUG   ] summary = ERROR
2019-01-21 02:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234383  13 58504  9514645 A  ERRORERROR'
2019-01-21 02:38:34 [DEBUG   ] Got command RPT from MCS: ref #1234385
2019-01-21 02:38:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234385  77 58504  9514849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:38:35 [DEBUG   ] Got command RPT from MCS: ref #1234387
2019-01-21 02:38:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 02:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234387  12 58504  9515053 A  ERRORB—™š'
2019-01-21 02:38:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:38:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:38:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:38:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:38:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:38:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:38:52 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-01-21 02:38:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 02:39:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 02:39:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 02:39:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:39:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:39:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:39:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:39:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:39:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:39:52 [DEBUG   ] Finished updating board flags in 1.625 seconds
2019-01-21 02:39:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 02:40:15 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 02:40:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 02:40:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:40:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:40:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:40:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:40:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:40:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:40:52 [DEBUG   ] Finished updating board flags in 1.628 seconds
2019-01-21 02:40:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 02:41:06 [DEBUG   ] Got command RPT from MCS: ref #1234395
2019-01-21 02:41:06 [DEBUG   ] summary = ERROR
2019-01-21 02:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234395  13 58504  9666841 A  ERRORERROR'
2019-01-21 02:41:06 [DEBUG   ] Got command RPT from MCS: ref #1234396
2019-01-21 02:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234396  77 58504  9666842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:41:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 02:41:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 02:41:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 02:41:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:41:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:41:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:41:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:41:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:41:52 [DEBUG   ] Finished updating board flags in 1.543 seconds
2019-01-21 02:41:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:42:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 02:42:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 02:42:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:42:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:42:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:42:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:42:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:42:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:42:52 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-01-21 02:42:55 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 02:43:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 02:43:34 [DEBUG   ] Got command RPT from MCS: ref #1234412
2019-01-21 02:43:34 [DEBUG   ] summary = ERROR
2019-01-21 02:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234412  13 58504  9814329 A  ERRORERROR'
2019-01-21 02:43:34 [DEBUG   ] Got command RPT from MCS: ref #1234413
2019-01-21 02:43:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234413  77 58504  9814534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:43:34 [DEBUG   ] Got command RPT from MCS: ref #1234414
2019-01-21 02:43:34 [DEBUG   ] summary = ERROR
2019-01-21 02:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234414  13 58504  9814742 A  ERRORERROR'
2019-01-21 02:43:34 [DEBUG   ] Got command RPT from MCS: ref #1234415
2019-01-21 02:43:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234415  77 58504  9814933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:43:35 [DEBUG   ] Got command RPT from MCS: ref #1234416
2019-01-21 02:43:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 02:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234416  12 58504  9815137 A  ERRORB•™š'
2019-01-21 02:43:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 02:43:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:43:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:43:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:43:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:43:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:43:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:43:52 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-21 02:43:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 02:44:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 02:44:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:44:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:44:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:44:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:44:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:44:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:44:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:44:52 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-21 02:44:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:45:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 02:45:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:45:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:45:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:45:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:45:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:45:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:45:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:45:52 [DEBUG   ] Finished updating board flags in 1.534 seconds
2019-01-21 02:45:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 02:46:06 [DEBUG   ] Got command RPT from MCS: ref #1234421
2019-01-21 02:46:06 [DEBUG   ] summary = ERROR
2019-01-21 02:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234421  13 58504  9966841 A  ERRORERROR'
2019-01-21 02:46:06 [DEBUG   ] Got command RPT from MCS: ref #1234422
2019-01-21 02:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234422  77 58504  9966842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:46:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:46:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 02:46:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:46:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:46:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:46:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:46:52 [WARNING ] (13, 1, 'bot')
2019-01-21 02:46:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:46:52 [DEBUG   ] Finished updating board flags in 1.536 seconds
2019-01-21 02:46:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 02:47:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 02:47:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:47:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:47:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:47:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:47:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:47:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:47:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:47:53 [DEBUG   ] Finished updating board flags in 2.216 seconds
2019-01-21 02:47:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 02:48:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 02:48:34 [DEBUG   ] Got command RPT from MCS: ref #1234444
2019-01-21 02:48:34 [DEBUG   ] summary = ERROR
2019-01-21 02:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234444  13 58504 10114413 A  ERRORERROR'
2019-01-21 02:48:34 [DEBUG   ] Got command RPT from MCS: ref #1234445
2019-01-21 02:48:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234445  77 58504 10114617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:48:34 [DEBUG   ] Got command RPT from MCS: ref #1234446
2019-01-21 02:48:34 [DEBUG   ] summary = ERROR
2019-01-21 02:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234446  13 58504 10114821 A  ERRORERROR'
2019-01-21 02:48:35 [DEBUG   ] Got command RPT from MCS: ref #1234448
2019-01-21 02:48:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234448  77 58504 10115013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:48:35 [DEBUG   ] Got command RPT from MCS: ref #1234450
2019-01-21 02:48:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 02:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234450  12 58504 10115217 A  ERRORB–™š'
2019-01-21 02:48:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 02:48:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:48:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:48:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:48:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:48:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:48:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:48:53 [DEBUG   ] Finished updating board flags in 2.083 seconds
2019-01-21 02:48:56 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-21 02:49:15 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-21 02:49:35 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-21 02:49:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:49:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 02:49:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:49:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:49:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:49:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:49:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:49:53 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-01-21 02:49:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 02:50:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 02:50:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 02:50:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:50:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:50:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:50:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:50:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:50:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:50:53 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-21 02:50:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:51:06 [DEBUG   ] Got command RPT from MCS: ref #1234458
2019-01-21 02:51:06 [DEBUG   ] summary = ERROR
2019-01-21 02:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234458  13 58504 10266849 A  ERRORERROR'
2019-01-21 02:51:06 [DEBUG   ] Got command RPT from MCS: ref #1234459
2019-01-21 02:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234459  77 58504 10266850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:51:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 02:51:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 02:51:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:51:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:51:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:51:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:51:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:51:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:51:53 [DEBUG   ] Finished updating board flags in 1.982 seconds
2019-01-21 02:51:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 02:52:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 02:52:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 02:52:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:52:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:52:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:52:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:52:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:52:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:52:53 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-01-21 02:52:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 02:53:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 02:53:34 [DEBUG   ] Got command RPT from MCS: ref #1234479
2019-01-21 02:53:34 [DEBUG   ] summary = ERROR
2019-01-21 02:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234479  13 58504 10414505 A  ERRORERROR'
2019-01-21 02:53:34 [DEBUG   ] Got command RPT from MCS: ref #1234480
2019-01-21 02:53:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234480  77 58504 10414709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:53:34 [DEBUG   ] Got command RPT from MCS: ref #1234481
2019-01-21 02:53:34 [DEBUG   ] summary = ERROR
2019-01-21 02:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234481  13 58504 10414901 A  ERRORERROR'
2019-01-21 02:53:35 [DEBUG   ] Got command RPT from MCS: ref #1234482
2019-01-21 02:53:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234482  77 58504 10415105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:53:35 [DEBUG   ] Got command RPT from MCS: ref #1234483
2019-01-21 02:53:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 02:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234483  12 58504 10415309 A  ERRORB—™š'
2019-01-21 02:53:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:53:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-21 02:53:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:53:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:53:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:53:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:53:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:53:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:53:53 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-01-21 02:53:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 02:54:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 02:54:37 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2019-01-21 02:54:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:54:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:54:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:54:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:54:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:54:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:54:53 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-21 02:54:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 02:55:17 [DEBUG   ] Finished updating ant stats in 1.604 seconds
2019-01-21 02:55:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 02:55:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:55:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 02:55:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:55:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:55:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:55:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:55:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:55:53 [DEBUG   ] Finished updating board flags in 1.721 seconds
2019-01-21 02:55:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 02:56:06 [DEBUG   ] Got command RPT from MCS: ref #1234488
2019-01-21 02:56:06 [DEBUG   ] summary = ERROR
2019-01-21 02:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234488  13 58504 10566845 A  ERRORERROR'
2019-01-21 02:56:06 [DEBUG   ] Got command RPT from MCS: ref #1234489
2019-01-21 02:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234489  77 58504 10566846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:56:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 02:56:37 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 02:56:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:56:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:56:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:56:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:56:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:56:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:56:53 [DEBUG   ] Finished updating board flags in 1.496 seconds
2019-01-21 02:56:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 02:57:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 02:57:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 02:57:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:57:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:57:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:57:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:57:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:57:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:57:53 [DEBUG   ] Finished updating board flags in 1.471 seconds
2019-01-21 02:57:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 02:58:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 02:58:34 [DEBUG   ] Got command RPT from MCS: ref #1234507
2019-01-21 02:58:34 [DEBUG   ] summary = ERROR
2019-01-21 02:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234507  13 58504 10714585 A  ERRORERROR'
2019-01-21 02:58:34 [DEBUG   ] Got command RPT from MCS: ref #1234508
2019-01-21 02:58:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234508  77 58504 10714789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:58:34 [DEBUG   ] Got command RPT from MCS: ref #1234509
2019-01-21 02:58:34 [DEBUG   ] summary = ERROR
2019-01-21 02:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234509  13 58504 10714993 A  ERRORERROR'
2019-01-21 02:58:35 [DEBUG   ] Got command RPT from MCS: ref #1234511
2019-01-21 02:58:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 02:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234511  77 58504 10715185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 02:58:35 [DEBUG   ] Got command RPT from MCS: ref #1234512
2019-01-21 02:58:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 02:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234512  12 58504 10715389 A  ERRORB–™š'
2019-01-21 02:58:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:58:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:58:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:58:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:58:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:58:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:58:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:58:53 [DEBUG   ] Finished updating board flags in 1.472 seconds
2019-01-21 02:58:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 02:59:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 02:59:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 02:59:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 02:59:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:59:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:59:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:59:53 [WARNING ] (13, 1, 'bot')
2019-01-21 02:59:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 02:59:53 [DEBUG   ] Finished updating board flags in 1.499 seconds
2019-01-21 02:59:57 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-21 03:00:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 03:00:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 03:00:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:00:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:00:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:00:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:00:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:00:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:00:54 [DEBUG   ] Finished updating board flags in 2.181 seconds
2019-01-21 03:00:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 03:01:06 [DEBUG   ] Got command RPT from MCS: ref #1234521
2019-01-21 03:01:06 [DEBUG   ] summary = ERROR
2019-01-21 03:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234521  13 58504 10866845 A  ERRORERROR'
2019-01-21 03:01:06 [DEBUG   ] Got command RPT from MCS: ref #1234522
2019-01-21 03:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234522  77 58504 10866846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:01:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 03:01:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 03:01:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:01:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:01:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:01:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:01:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:01:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:01:54 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-01-21 03:01:58 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 03:02:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 03:02:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 03:02:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:02:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:02:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:02:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:02:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:02:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:02:54 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-21 03:02:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 03:03:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 03:03:34 [DEBUG   ] Got command RPT from MCS: ref #1234542
2019-01-21 03:03:34 [DEBUG   ] summary = ERROR
2019-01-21 03:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234542  13 58504 11014677 A  ERRORERROR'
2019-01-21 03:03:34 [DEBUG   ] Got command RPT from MCS: ref #1234543
2019-01-21 03:03:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234543  77 58504 11014881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:03:35 [DEBUG   ] Got command RPT from MCS: ref #1234544
2019-01-21 03:03:35 [DEBUG   ] summary = ERROR
2019-01-21 03:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234544  13 58504 11015073 A  ERRORERROR'
2019-01-21 03:03:35 [DEBUG   ] Got command RPT from MCS: ref #1234545
2019-01-21 03:03:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234545  77 58504 11015277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:03:35 [DEBUG   ] Got command RPT from MCS: ref #1234546
2019-01-21 03:03:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 03:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234546  12 58504 11015481 A  ERRORB–™š'
2019-01-21 03:03:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:03:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 03:03:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:03:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:03:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:03:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:03:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:03:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:03:54 [DEBUG   ] Finished updating board flags in 1.774 seconds
2019-01-21 03:03:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 03:04:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 03:04:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 03:04:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 03:04:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:04:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 03:04:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:04:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:04:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:04:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:04:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:04:54 [DEBUG   ] Finished updating board flags in 1.624 seconds
2019-01-21 03:04:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:05:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 03:05:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 03:05:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:05:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:05:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:05:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:05:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:05:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:05:54 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-01-21 03:05:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 03:06:06 [DEBUG   ] Got command RPT from MCS: ref #1234551
2019-01-21 03:06:06 [DEBUG   ] summary = ERROR
2019-01-21 03:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234551  13 58504 11166845 A  ERRORERROR'
2019-01-21 03:06:06 [DEBUG   ] Got command RPT from MCS: ref #1234552
2019-01-21 03:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234552  77 58504 11166846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:06:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 03:06:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 03:06:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:06:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:06:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:06:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:06:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:06:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:06:54 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-21 03:06:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 03:07:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 03:07:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 03:07:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:07:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:07:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:07:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:07:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:07:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:07:54 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-21 03:07:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 03:08:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 03:08:34 [DEBUG   ] Got command RPT from MCS: ref #1234574
2019-01-21 03:08:34 [DEBUG   ] summary = ERROR
2019-01-21 03:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234574  13 58504 11314765 A  ERRORERROR'
2019-01-21 03:08:34 [DEBUG   ] Got command RPT from MCS: ref #1234575
2019-01-21 03:08:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234575  77 58504 11314957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:08:35 [DEBUG   ] Got command RPT from MCS: ref #1234576
2019-01-21 03:08:35 [DEBUG   ] summary = ERROR
2019-01-21 03:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234576  13 58504 11315161 A  ERRORERROR'
2019-01-21 03:08:35 [DEBUG   ] Got command RPT from MCS: ref #1234578
2019-01-21 03:08:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234578  77 58504 11315365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:08:35 [DEBUG   ] Got command RPT from MCS: ref #1234579
2019-01-21 03:08:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 03:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234579  12 58504 11315569 A  ERRORB—™š'
2019-01-21 03:08:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 03:08:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:08:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:08:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:08:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:08:54 [WARNING ] (13, 1, 'bot')
2019-01-21 03:08:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:08:54 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-21 03:08:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 03:09:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:09:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 03:09:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:09:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:09:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:09:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:09:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:09:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:09:55 [DEBUG   ] Finished updating board flags in 2.207 seconds
2019-01-21 03:09:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:10:19 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-21 03:10:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 03:10:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:10:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:10:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:10:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:10:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:10:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:10:55 [DEBUG   ] Finished updating board flags in 2.195 seconds
2019-01-21 03:10:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:11:06 [DEBUG   ] Got command RPT from MCS: ref #1234588
2019-01-21 03:11:06 [DEBUG   ] summary = ERROR
2019-01-21 03:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234588  13 58504 11466849 A  ERRORERROR'
2019-01-21 03:11:06 [DEBUG   ] Got command RPT from MCS: ref #1234589
2019-01-21 03:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234589  77 58504 11466850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:11:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:11:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 03:11:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:11:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:11:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:11:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:11:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:11:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:11:55 [DEBUG   ] Finished updating board flags in 2.040 seconds
2019-01-21 03:11:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 03:12:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 03:12:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 03:12:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:12:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:12:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:12:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:12:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:12:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:12:55 [DEBUG   ] Finished updating board flags in 1.957 seconds
2019-01-21 03:12:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 03:13:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 03:13:34 [DEBUG   ] Got command RPT from MCS: ref #1234605
2019-01-21 03:13:34 [DEBUG   ] summary = ERROR
2019-01-21 03:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234605  13 58504 11614849 A  ERRORERROR'
2019-01-21 03:13:35 [DEBUG   ] Got command RPT from MCS: ref #1234606
2019-01-21 03:13:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234606  77 58504 11615041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:13:35 [DEBUG   ] Got command RPT from MCS: ref #1234607
2019-01-21 03:13:35 [DEBUG   ] summary = ERROR
2019-01-21 03:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234607  13 58504 11615245 A  ERRORERROR'
2019-01-21 03:13:35 [DEBUG   ] Got command RPT from MCS: ref #1234608
2019-01-21 03:13:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234608  77 58504 11615449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:13:35 [DEBUG   ] Got command RPT from MCS: ref #1234609
2019-01-21 03:13:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 03:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234609  12 58504 11615653 A  ERRORB—™š'
2019-01-21 03:13:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 03:13:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:13:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 03:13:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:13:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:13:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:13:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:13:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:13:55 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-21 03:13:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 03:14:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 03:14:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 03:14:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:14:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 03:14:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:14:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:14:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:14:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:14:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:14:55 [DEBUG   ] Finished updating board flags in 1.849 seconds
2019-01-21 03:14:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 03:15:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 03:15:39 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-21 03:15:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:15:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 03:15:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:15:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:15:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:15:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:15:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:15:55 [DEBUG   ] Finished updating board flags in 1.751 seconds
2019-01-21 03:15:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 03:16:06 [DEBUG   ] Got command RPT from MCS: ref #1234614
2019-01-21 03:16:06 [DEBUG   ] summary = ERROR
2019-01-21 03:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234614  13 58504 11766849 A  ERRORERROR'
2019-01-21 03:16:06 [DEBUG   ] Got command RPT from MCS: ref #1234615
2019-01-21 03:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234615  77 58504 11766850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:16:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 03:16:40 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 03:16:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:16:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:16:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:16:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:16:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:16:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:16:55 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-21 03:17:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 03:17:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 03:17:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 03:17:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:17:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:17:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:17:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:17:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:17:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:17:55 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-21 03:18:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 03:18:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 03:18:34 [DEBUG   ] Got command RPT from MCS: ref #1234637
2019-01-21 03:18:34 [DEBUG   ] summary = ERROR
2019-01-21 03:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234637  13 58504 11914929 A  ERRORERROR'
2019-01-21 03:18:35 [DEBUG   ] Got command RPT from MCS: ref #1234638
2019-01-21 03:18:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234638  77 58504 11915133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:18:35 [DEBUG   ] Got command RPT from MCS: ref #1234639
2019-01-21 03:18:35 [DEBUG   ] summary = ERROR
2019-01-21 03:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234639  13 58504 11915337 A  ERRORERROR'
2019-01-21 03:18:35 [DEBUG   ] Got command RPT from MCS: ref #1234641
2019-01-21 03:18:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234641  77 58504 11915529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:18:35 [DEBUG   ] Got command RPT from MCS: ref #1234642
2019-01-21 03:18:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 03:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234642  12 58504 11915733 A  ERRORB–™š'
2019-01-21 03:18:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:18:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:18:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:18:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:18:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:18:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:18:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:18:55 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-21 03:19:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:19:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 03:19:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 03:19:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:19:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:19:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:19:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:19:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:19:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:19:55 [DEBUG   ] Finished updating board flags in 1.448 seconds
2019-01-21 03:20:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:20:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 03:20:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 03:20:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:20:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:20:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:20:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:20:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:20:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:20:55 [DEBUG   ] Finished updating board flags in 1.458 seconds
2019-01-21 03:21:00 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-21 03:21:06 [DEBUG   ] Got command RPT from MCS: ref #1234651
2019-01-21 03:21:06 [DEBUG   ] summary = ERROR
2019-01-21 03:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234651  13 58504 12066853 A  ERRORERROR'
2019-01-21 03:21:06 [DEBUG   ] Got command RPT from MCS: ref #1234652
2019-01-21 03:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234652  77 58504 12066854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:21:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 03:21:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 03:21:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:21:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:21:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:21:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:21:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:21:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:21:55 [DEBUG   ] Finished updating board flags in 1.459 seconds
2019-01-21 03:22:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 03:22:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 03:22:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 03:22:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:22:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:22:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:22:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:22:55 [WARNING ] (13, 1, 'bot')
2019-01-21 03:22:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:22:55 [DEBUG   ] Finished updating board flags in 1.456 seconds
2019-01-21 03:23:01 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 03:23:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 03:23:35 [DEBUG   ] Got command RPT from MCS: ref #1234672
2019-01-21 03:23:35 [DEBUG   ] summary = ERROR
2019-01-21 03:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234672  13 58504 12215021 A  ERRORERROR'
2019-01-21 03:23:35 [DEBUG   ] Got command RPT from MCS: ref #1234673
2019-01-21 03:23:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234673  77 58504 12215213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:23:35 [DEBUG   ] Got command RPT from MCS: ref #1234674
2019-01-21 03:23:35 [DEBUG   ] summary = ERROR
2019-01-21 03:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234674  13 58504 12215417 A  ERRORERROR'
2019-01-21 03:23:35 [DEBUG   ] Got command RPT from MCS: ref #1234675
2019-01-21 03:23:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234675  77 58504 12215621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:23:35 [DEBUG   ] Got command RPT from MCS: ref #1234676
2019-01-21 03:23:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 03:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234676  12 58504 12215825 A  ERRORB•™š'
2019-01-21 03:23:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:23:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 03:23:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:23:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:23:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:23:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:23:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:23:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:23:56 [DEBUG   ] Finished updating board flags in 2.236 seconds
2019-01-21 03:24:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-21 03:24:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 03:24:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 03:24:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:24:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:24:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:24:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:24:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:24:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:24:56 [DEBUG   ] Finished updating board flags in 2.165 seconds
2019-01-21 03:25:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 03:25:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:25:42 [DEBUG   ] Finished updating ant stats in 1.802 seconds
2019-01-21 03:25:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:25:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:25:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:25:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:25:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:25:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:25:56 [DEBUG   ] Finished updating board flags in 2.001 seconds
2019-01-21 03:26:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 03:26:06 [DEBUG   ] Got command RPT from MCS: ref #1234681
2019-01-21 03:26:06 [DEBUG   ] summary = ERROR
2019-01-21 03:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234681  13 58504 12366845 A  ERRORERROR'
2019-01-21 03:26:06 [DEBUG   ] Got command RPT from MCS: ref #1234682
2019-01-21 03:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234682  77 58504 12366846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:26:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 03:26:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 03:26:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:26:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:26:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:26:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:26:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:26:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:26:56 [DEBUG   ] Finished updating board flags in 2.001 seconds
2019-01-21 03:27:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-01-21 03:27:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 03:27:42 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2019-01-21 03:27:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:27:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:27:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:27:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:27:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:27:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:27:56 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-01-21 03:28:01 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2019-01-21 03:28:22 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-01-21 03:28:35 [DEBUG   ] Got command RPT from MCS: ref #1234700
2019-01-21 03:28:35 [DEBUG   ] summary = ERROR
2019-01-21 03:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234700  13 58504 12515101 A  ERRORERROR'
2019-01-21 03:28:35 [DEBUG   ] Got command RPT from MCS: ref #1234701
2019-01-21 03:28:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234701  77 58504 12515305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:28:35 [DEBUG   ] Got command RPT from MCS: ref #1234702
2019-01-21 03:28:35 [DEBUG   ] summary = ERROR
2019-01-21 03:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234702  13 58504 12515509 A  ERRORERROR'
2019-01-21 03:28:35 [DEBUG   ] Got command RPT from MCS: ref #1234704
2019-01-21 03:28:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234704  77 58504 12515701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:28:35 [DEBUG   ] Got command RPT from MCS: ref #1234705
2019-01-21 03:28:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 03:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234705  12 58504 12515905 A  ERRORB˜™š'
2019-01-21 03:28:42 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 03:28:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:28:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:28:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:28:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:28:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:28:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:28:56 [DEBUG   ] Finished updating board flags in 1.976 seconds
2019-01-21 03:29:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 03:29:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 03:29:42 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-21 03:29:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:29:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:29:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:29:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:29:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:29:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:29:56 [DEBUG   ] Finished updating board flags in 1.796 seconds
2019-01-21 03:30:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 03:30:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 03:30:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 03:30:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:30:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:30:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:30:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:30:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:30:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:30:56 [DEBUG   ] Finished updating board flags in 1.576 seconds
2019-01-21 03:31:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 03:31:06 [DEBUG   ] Got command RPT from MCS: ref #1234714
2019-01-21 03:31:06 [DEBUG   ] summary = ERROR
2019-01-21 03:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234714  13 58504 12666857 A  ERRORERROR'
2019-01-21 03:31:06 [DEBUG   ] Got command RPT from MCS: ref #1234715
2019-01-21 03:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234715  77 58504 12666858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:31:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 03:31:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 03:31:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:31:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:31:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:31:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:31:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:31:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:31:56 [DEBUG   ] Finished updating board flags in 1.524 seconds
2019-01-21 03:32:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 03:32:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:32:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:32:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:32:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:32:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:32:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:32:56 [WARNING ] (13, 1, 'bot')
2019-01-21 03:32:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:32:56 [DEBUG   ] Finished updating board flags in 1.559 seconds
2019-01-21 03:33:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 03:33:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 03:33:35 [DEBUG   ] Got command RPT from MCS: ref #1234735
2019-01-21 03:33:35 [DEBUG   ] summary = ERROR
2019-01-21 03:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234735  13 58504 12815189 A  ERRORERROR'
2019-01-21 03:33:35 [DEBUG   ] Got command RPT from MCS: ref #1234736
2019-01-21 03:33:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234736  77 58504 12815393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:33:35 [DEBUG   ] Got command RPT from MCS: ref #1234737
2019-01-21 03:33:35 [DEBUG   ] summary = ERROR
2019-01-21 03:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234737  13 58504 12815585 A  ERRORERROR'
2019-01-21 03:33:35 [DEBUG   ] Got command RPT from MCS: ref #1234738
2019-01-21 03:33:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234738  77 58504 12815789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:33:35 [DEBUG   ] Got command RPT from MCS: ref #1234739
2019-01-21 03:33:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 03:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234739  12 58504 12815993 A  ERRORB–™š'
2019-01-21 03:33:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 03:33:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:33:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:33:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:33:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:33:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:33:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:33:57 [DEBUG   ] Finished updating board flags in 2.249 seconds
2019-01-21 03:34:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:34:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 03:34:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 03:34:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:34:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:34:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:34:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:34:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:34:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:34:57 [DEBUG   ] Finished updating board flags in 2.081 seconds
2019-01-21 03:35:02 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-21 03:35:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 03:35:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 03:35:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:35:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:35:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:35:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:35:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:35:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:35:57 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-01-21 03:36:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 03:36:06 [DEBUG   ] Got command RPT from MCS: ref #1234744
2019-01-21 03:36:06 [DEBUG   ] summary = ERROR
2019-01-21 03:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234744  13 58504 12966857 A  ERRORERROR'
2019-01-21 03:36:06 [DEBUG   ] Got command RPT from MCS: ref #1234745
2019-01-21 03:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234745  77 58504 12966858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:36:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 03:36:43 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 03:36:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:36:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:36:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:36:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:36:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:36:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:36:57 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-01-21 03:37:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 03:37:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 03:37:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 03:37:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:37:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:37:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:37:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:37:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:37:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:37:57 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-01-21 03:38:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 03:38:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 03:38:35 [DEBUG   ] Got command RPT from MCS: ref #1234767
2019-01-21 03:38:35 [DEBUG   ] summary = ERROR
2019-01-21 03:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234767  13 58504 13115269 A  ERRORERROR'
2019-01-21 03:38:35 [DEBUG   ] Got command RPT from MCS: ref #1234768
2019-01-21 03:38:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234768  77 58504 13115473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:38:35 [DEBUG   ] Got command RPT from MCS: ref #1234769
2019-01-21 03:38:35 [DEBUG   ] summary = ERROR
2019-01-21 03:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234769  13 58504 13115677 A  ERRORERROR'
2019-01-21 03:38:35 [DEBUG   ] Got command RPT from MCS: ref #1234771
2019-01-21 03:38:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234771  77 58504 13115873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:38:36 [DEBUG   ] Got command RPT from MCS: ref #1234772
2019-01-21 03:38:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 03:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234772  12 58504 13116077 A  ERRORB–™š'
2019-01-21 03:38:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:38:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:38:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:38:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:38:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:38:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:38:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:38:57 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-01-21 03:39:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 03:39:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 03:39:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 03:39:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:39:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:39:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:39:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:39:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:39:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:39:57 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-01-21 03:40:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:40:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:40:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-21 03:40:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 03:40:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:40:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 03:40:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:40:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:40:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:40:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:40:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:40:57 [DEBUG   ] Finished updating board flags in 1.375 seconds
2019-01-21 03:41:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 03:41:06 [DEBUG   ] Got command RPT from MCS: ref #1234781
2019-01-21 03:41:06 [DEBUG   ] summary = ERROR
2019-01-21 03:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234781  13 58504 13266857 A  ERRORERROR'
2019-01-21 03:41:06 [DEBUG   ] Got command RPT from MCS: ref #1234782
2019-01-21 03:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234782  77 58504 13266858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:41:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 03:41:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 03:41:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:41:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 03:41:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-21 03:41:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:41:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:41:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:41:57 [WARNING ] (13, 1, 'bot')
2019-01-21 03:41:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:41:57 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-01-21 03:42:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 03:42:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 03:42:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 03:42:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:42:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:42:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:42:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:42:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:42:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:42:58 [DEBUG   ] Finished updating board flags in 2.055 seconds
2019-01-21 03:43:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 03:43:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 03:43:35 [DEBUG   ] Got command RPT from MCS: ref #1234798
2019-01-21 03:43:35 [DEBUG   ] summary = ERROR
2019-01-21 03:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234798  13 58504 13415361 A  ERRORERROR'
2019-01-21 03:43:35 [DEBUG   ] Got command RPT from MCS: ref #1234799
2019-01-21 03:43:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234799  77 58504 13415553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:43:35 [DEBUG   ] Got command RPT from MCS: ref #1234800
2019-01-21 03:43:35 [DEBUG   ] summary = ERROR
2019-01-21 03:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234800  13 58504 13415757 A  ERRORERROR'
2019-01-21 03:43:35 [DEBUG   ] Got command RPT from MCS: ref #1234801
2019-01-21 03:43:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234801  77 58504 13415961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:43:36 [DEBUG   ] Got command RPT from MCS: ref #1234802
2019-01-21 03:43:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 03:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234802  12 58504 13416165 A  ERRORB—™š'
2019-01-21 03:43:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 03:43:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:43:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:43:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:43:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:43:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:43:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:43:58 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-01-21 03:44:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 03:44:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 03:44:44 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 03:44:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:44:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:44:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:44:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:44:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:44:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:44:58 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-01-21 03:45:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:45:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:45:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 03:45:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:45:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:45:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:45:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:45:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:45:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:45:58 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-21 03:46:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 03:46:06 [DEBUG   ] Got command RPT from MCS: ref #1234807
2019-01-21 03:46:06 [DEBUG   ] summary = ERROR
2019-01-21 03:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234807  13 58504 13566849 A  ERRORERROR'
2019-01-21 03:46:06 [DEBUG   ] Got command RPT from MCS: ref #1234808
2019-01-21 03:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234808  77 58504 13566850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:46:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:46:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 03:46:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:46:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:46:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:46:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:46:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:46:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:46:58 [DEBUG   ] Finished updating board flags in 1.839 seconds
2019-01-21 03:47:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 03:47:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 03:47:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:47:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:47:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:47:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:47:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:47:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:47:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:47:58 [DEBUG   ] Finished updating board flags in 1.847 seconds
2019-01-21 03:48:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:48:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 03:48:35 [DEBUG   ] Got command RPT from MCS: ref #1234830
2019-01-21 03:48:35 [DEBUG   ] summary = ERROR
2019-01-21 03:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234830  13 58504 13715449 A  ERRORERROR'
2019-01-21 03:48:35 [DEBUG   ] Got command RPT from MCS: ref #1234831
2019-01-21 03:48:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234831  77 58504 13715641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:48:35 [DEBUG   ] Got command RPT from MCS: ref #1234832
2019-01-21 03:48:35 [DEBUG   ] summary = ERROR
2019-01-21 03:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234832  13 58504 13715845 A  ERRORERROR'
2019-01-21 03:48:36 [DEBUG   ] Got command RPT from MCS: ref #1234834
2019-01-21 03:48:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234834  77 58504 13716049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:48:36 [DEBUG   ] Got command RPT from MCS: ref #1234835
2019-01-21 03:48:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 03:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234835  12 58504 13716253 A  ERRORB—™š'
2019-01-21 03:48:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 03:48:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:48:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:48:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:48:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:48:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:48:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:48:58 [DEBUG   ] Finished updating board flags in 1.706 seconds
2019-01-21 03:49:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:49:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 03:49:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 03:49:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:49:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:49:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:49:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:49:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:49:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:49:58 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-21 03:50:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 03:50:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:50:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 03:50:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:50:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:50:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:50:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:50:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:50:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:50:58 [DEBUG   ] Finished updating board flags in 1.579 seconds
2019-01-21 03:51:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 03:51:06 [DEBUG   ] Got command RPT from MCS: ref #1234844
2019-01-21 03:51:06 [DEBUG   ] summary = ERROR
2019-01-21 03:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234844  13 58504 13866857 A  ERRORERROR'
2019-01-21 03:51:06 [DEBUG   ] Got command RPT from MCS: ref #1234845
2019-01-21 03:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234845  77 58504 13866858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:51:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 03:51:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:51:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:51:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 03:51:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:51:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:51:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:51:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:51:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:51:58 [DEBUG   ] Finished updating board flags in 1.438 seconds
2019-01-21 03:52:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:52:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 03:52:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:52:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:52:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:52:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:52:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:52:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:52:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:52:58 [DEBUG   ] Finished updating board flags in 1.487 seconds
2019-01-21 03:53:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:53:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 03:53:35 [DEBUG   ] Got command RPT from MCS: ref #1234865
2019-01-21 03:53:35 [DEBUG   ] summary = ERROR
2019-01-21 03:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234865  13 58504 14015533 A  ERRORERROR'
2019-01-21 03:53:35 [DEBUG   ] Got command RPT from MCS: ref #1234866
2019-01-21 03:53:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234866  77 58504 14015737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:53:35 [DEBUG   ] Got command RPT from MCS: ref #1234867
2019-01-21 03:53:35 [DEBUG   ] summary = ERROR
2019-01-21 03:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234867  13 58504 14015929 A  ERRORERROR'
2019-01-21 03:53:36 [DEBUG   ] Got command RPT from MCS: ref #1234868
2019-01-21 03:53:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234868  77 58504 14016133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:53:36 [DEBUG   ] Got command RPT from MCS: ref #1234869
2019-01-21 03:53:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 03:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234869  12 58504 14016337 A  ERRORB–™š'
2019-01-21 03:53:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 03:53:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:53:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 03:53:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:53:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:53:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:53:58 [WARNING ] (13, 1, 'bot')
2019-01-21 03:53:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:53:58 [DEBUG   ] Finished updating board flags in 1.491 seconds
2019-01-21 03:54:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 03:54:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:54:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 03:54:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:54:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:54:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:54:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:54:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:54:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:54:59 [DEBUG   ] Finished updating board flags in 2.319 seconds
2019-01-21 03:55:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 03:55:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 03:55:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 03:55:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:55:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:55:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:55:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:55:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:55:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:55:59 [DEBUG   ] Finished updating board flags in 2.079 seconds
2019-01-21 03:56:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 03:56:06 [DEBUG   ] Got command RPT from MCS: ref #1234874
2019-01-21 03:56:06 [DEBUG   ] summary = ERROR
2019-01-21 03:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234874  13 58504 14166861 A  ERRORERROR'
2019-01-21 03:56:06 [DEBUG   ] Got command RPT from MCS: ref #1234875
2019-01-21 03:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234875  77 58504 14166862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:56:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 03:56:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 03:56:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:56:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:56:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:56:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:56:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:56:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:56:59 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-21 03:57:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 03:57:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 03:57:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 03:57:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:57:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:57:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:57:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:57:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:57:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:57:59 [DEBUG   ] Finished updating board flags in 2.022 seconds
2019-01-21 03:58:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 03:58:25 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 03:58:35 [DEBUG   ] Got command RPT from MCS: ref #1234893
2019-01-21 03:58:35 [DEBUG   ] summary = ERROR
2019-01-21 03:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234893  13 58504 14315621 A  ERRORERROR'
2019-01-21 03:58:35 [DEBUG   ] Got command RPT from MCS: ref #1234894
2019-01-21 03:58:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234894  77 58504 14315813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:58:36 [DEBUG   ] Got command RPT from MCS: ref #1234895
2019-01-21 03:58:36 [DEBUG   ] summary = ERROR
2019-01-21 03:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234895  13 58504 14316017 A  ERRORERROR'
2019-01-21 03:58:36 [DEBUG   ] Got command RPT from MCS: ref #1234897
2019-01-21 03:58:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 03:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234897  77 58504 14316221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 03:58:36 [DEBUG   ] Got command RPT from MCS: ref #1234899
2019-01-21 03:58:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 03:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234899  12 58504 14316425 A  ERRORB•™š'
2019-01-21 03:58:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 03:58:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:58:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:58:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:58:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:58:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:58:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:58:59 [DEBUG   ] Finished updating board flags in 1.973 seconds
2019-01-21 03:59:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 03:59:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 03:59:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 03:59:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 03:59:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 03:59:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 03:59:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:59:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:59:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:59:59 [WARNING ] (13, 1, 'bot')
2019-01-21 03:59:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 03:59:59 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-21 04:00:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 04:00:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 04:00:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 04:00:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:00:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:00:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:00:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:00:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:00:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:00:59 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-21 04:01:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 04:01:06 [DEBUG   ] Got command RPT from MCS: ref #1234907
2019-01-21 04:01:06 [DEBUG   ] summary = ERROR
2019-01-21 04:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234907  13 58504 14466861 A  ERRORERROR'
2019-01-21 04:01:06 [DEBUG   ] Got command RPT from MCS: ref #1234908
2019-01-21 04:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234908  77 58504 14466862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:01:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 04:01:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 04:01:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:01:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:01:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:01:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:01:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:01:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:01:59 [DEBUG   ] Finished updating board flags in 1.670 seconds
2019-01-21 04:02:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:02:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:02:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 04:02:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:02:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:02:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:02:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:02:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:02:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:02:59 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-21 04:03:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 04:03:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:03:35 [DEBUG   ] Got command RPT from MCS: ref #1234928
2019-01-21 04:03:35 [DEBUG   ] summary = ERROR
2019-01-21 04:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234928  13 58504 14615705 A  ERRORERROR'
2019-01-21 04:03:35 [DEBUG   ] Got command RPT from MCS: ref #1234929
2019-01-21 04:03:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234929  77 58504 14615909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:03:36 [DEBUG   ] Got command RPT from MCS: ref #1234930
2019-01-21 04:03:36 [DEBUG   ] summary = ERROR
2019-01-21 04:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234930  13 58504 14616101 A  ERRORERROR'
2019-01-21 04:03:36 [DEBUG   ] Got command RPT from MCS: ref #1234931
2019-01-21 04:03:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234931  77 58504 14616305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:03:36 [DEBUG   ] Got command RPT from MCS: ref #1234932
2019-01-21 04:03:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 04:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234932  12 58504 14616509 A  ERRORB—™š'
2019-01-21 04:03:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:03:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 04:03:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:03:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:03:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:03:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:03:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:03:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:03:59 [DEBUG   ] Finished updating board flags in 1.518 seconds
2019-01-21 04:04:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 04:04:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 04:04:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 04:04:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 04:04:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:04:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:04:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:04:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:04:59 [WARNING ] (13, 1, 'bot')
2019-01-21 04:04:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:04:59 [DEBUG   ] Finished updating board flags in 1.517 seconds
2019-01-21 04:05:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 04:05:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 04:05:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 04:05:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:06:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:06:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:06:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:06:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:06:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:06:00 [DEBUG   ] Finished updating board flags in 2.206 seconds
2019-01-21 04:06:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:06:06 [DEBUG   ] Got command RPT from MCS: ref #1234937
2019-01-21 04:06:06 [DEBUG   ] summary = ERROR
2019-01-21 04:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234937  13 58504 14766857 A  ERRORERROR'
2019-01-21 04:06:06 [DEBUG   ] Got command RPT from MCS: ref #1234938
2019-01-21 04:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234938  77 58504 14766858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:06:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:06:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 04:06:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:07:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:07:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:07:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:07:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:07:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:07:00 [DEBUG   ] Finished updating board flags in 2.128 seconds
2019-01-21 04:07:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 04:07:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:07:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:07:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:08:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:08:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:08:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:08:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:08:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:08:00 [DEBUG   ] Finished updating board flags in 2.041 seconds
2019-01-21 04:08:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 04:08:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 04:08:35 [DEBUG   ] Got command RPT from MCS: ref #1234960
2019-01-21 04:08:35 [DEBUG   ] summary = ERROR
2019-01-21 04:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234960  13 58504 14915785 A  ERRORERROR'
2019-01-21 04:08:35 [DEBUG   ] Got command RPT from MCS: ref #1234961
2019-01-21 04:08:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234961  77 58504 14915989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:08:36 [DEBUG   ] Got command RPT from MCS: ref #1234962
2019-01-21 04:08:36 [DEBUG   ] summary = ERROR
2019-01-21 04:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234962  13 58504 14916193 A  ERRORERROR'
2019-01-21 04:08:36 [DEBUG   ] Got command RPT from MCS: ref #1234964
2019-01-21 04:08:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234964  77 58504 14916416 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:08:36 [DEBUG   ] Got command RPT from MCS: ref #1234965
2019-01-21 04:08:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 04:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234965  12 58504 14916593 A  ERRORB–™š'
2019-01-21 04:08:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 04:08:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:09:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:09:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:09:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:09:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:09:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:09:00 [DEBUG   ] Finished updating board flags in 1.953 seconds
2019-01-21 04:09:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 04:09:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 04:09:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:09:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:10:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 04:10:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:10:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:10:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:10:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:10:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:10:00 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-21 04:10:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 04:10:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 04:10:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 04:10:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:11:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:11:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:11:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:11:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:11:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:11:00 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-01-21 04:11:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:11:06 [DEBUG   ] Got command RPT from MCS: ref #1234974
2019-01-21 04:11:06 [DEBUG   ] summary = ERROR
2019-01-21 04:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234974  13 58504 15066861 A  ERRORERROR'
2019-01-21 04:11:06 [DEBUG   ] Got command RPT from MCS: ref #1234975
2019-01-21 04:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234975  77 58504 15066862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:11:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 04:11:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 04:11:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:12:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:12:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:12:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:12:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:12:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:12:00 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-21 04:12:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 04:12:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 04:12:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 04:12:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:13:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:13:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:13:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:13:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:13:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:13:00 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-21 04:13:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:13:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 04:13:35 [DEBUG   ] Got command RPT from MCS: ref #1234991
2019-01-21 04:13:35 [DEBUG   ] summary = ERROR
2019-01-21 04:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234991  13 58504 15215877 A  ERRORERROR'
2019-01-21 04:13:36 [DEBUG   ] Got command RPT from MCS: ref #1234992
2019-01-21 04:13:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234992  77 58504 15216081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:13:36 [DEBUG   ] Got command RPT from MCS: ref #1234993
2019-01-21 04:13:36 [DEBUG   ] summary = ERROR
2019-01-21 04:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234993  13 58504 15216273 A  ERRORERROR'
2019-01-21 04:13:36 [DEBUG   ] Got command RPT from MCS: ref #1234994
2019-01-21 04:13:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234994  77 58504 15216477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:13:36 [DEBUG   ] Got command RPT from MCS: ref #1234995
2019-01-21 04:13:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 04:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1234995  12 58504 15216681 A  ERRORB•™š'
2019-01-21 04:13:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-21 04:13:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:14:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 04:14:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:14:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:14:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:14:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:14:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:14:00 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-21 04:14:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 04:14:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 04:14:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 04:14:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:15:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-01-21 04:15:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:15:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:15:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:15:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:15:00 [WARNING ] (25, 5, 'bot')
2019-01-21 04:15:00 [WARNING ] (25, 5, 'bot')
2019-01-21 04:15:00 [WARNING ] (25, 5, 'bot')
2019-01-21 04:15:00 [WARNING ] (25, 5, 'bot')
2019-01-21 04:15:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:15:00 [DEBUG   ] Finished updating board flags in 1.401 seconds
2019-01-21 04:15:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 04:15:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 04:15:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:15:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:16:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 04:16:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:16:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:16:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:16:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:16:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:16:00 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-01-21 04:16:06 [DEBUG   ] Got command RPT from MCS: ref #1235000
2019-01-21 04:16:06 [DEBUG   ] summary = ERROR
2019-01-21 04:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235000  13 58504 15366861 A  ERRORERROR'
2019-01-21 04:16:06 [DEBUG   ] Got command RPT from MCS: ref #1235001
2019-01-21 04:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235001  77 58504 15366862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:16:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:16:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-21 04:16:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 04:17:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:17:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:17:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:17:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:17:00 [WARNING ] (13, 1, 'bot')
2019-01-21 04:17:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:17:00 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-01-21 04:17:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 04:17:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 04:17:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 04:18:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 04:18:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:18:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:18:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:18:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:18:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:18:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:18:01 [DEBUG   ] Finished updating board flags in 2.061 seconds
2019-01-21 04:18:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 04:18:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 04:18:35 [DEBUG   ] Got command RPT from MCS: ref #1235023
2019-01-21 04:18:35 [DEBUG   ] summary = ERROR
2019-01-21 04:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235023  13 58504 15515965 A  ERRORERROR'
2019-01-21 04:18:36 [DEBUG   ] Got command RPT from MCS: ref #1235024
2019-01-21 04:18:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235024  77 58504 15516157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:18:36 [DEBUG   ] Got command RPT from MCS: ref #1235025
2019-01-21 04:18:36 [DEBUG   ] summary = ERROR
2019-01-21 04:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235025  13 58504 15516361 A  ERRORERROR'
2019-01-21 04:18:36 [DEBUG   ] Got command RPT from MCS: ref #1235027
2019-01-21 04:18:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235027  77 58504 15516565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:18:36 [DEBUG   ] Got command RPT from MCS: ref #1235028
2019-01-21 04:18:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 04:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235028  12 58504 15516769 A  ERRORB—™š'
2019-01-21 04:18:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 04:19:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:19:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:19:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:19:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:19:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:19:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:19:01 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-21 04:19:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 04:19:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:19:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 04:20:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:20:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:20:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:20:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:20:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:20:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:20:01 [DEBUG   ] Finished updating board flags in 1.825 seconds
2019-01-21 04:20:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 04:20:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 04:20:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 04:21:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 04:21:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:21:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:21:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:21:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:21:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:21:01 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-01-21 04:21:06 [DEBUG   ] Got command RPT from MCS: ref #1235037
2019-01-21 04:21:06 [DEBUG   ] summary = ERROR
2019-01-21 04:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235037  13 58504 15666861 A  ERRORERROR'
2019-01-21 04:21:06 [DEBUG   ] Got command RPT from MCS: ref #1235038
2019-01-21 04:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235038  77 58504 15666862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:21:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 04:21:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 04:21:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 04:22:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:22:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 04:22:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:22:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:22:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:22:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:22:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:22:01 [DEBUG   ] Finished updating board flags in 1.662 seconds
2019-01-21 04:22:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 04:22:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 04:22:48 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-21 04:23:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:23:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:23:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:23:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:23:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:23:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:23:01 [DEBUG   ] Finished updating board flags in 1.536 seconds
2019-01-21 04:23:09 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-21 04:23:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 04:23:36 [DEBUG   ] Got command RPT from MCS: ref #1235058
2019-01-21 04:23:36 [DEBUG   ] summary = ERROR
2019-01-21 04:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235058  13 58504 15816041 A  ERRORERROR'
2019-01-21 04:23:36 [DEBUG   ] Got command RPT from MCS: ref #1235059
2019-01-21 04:23:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235059  77 58504 15816245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:23:36 [DEBUG   ] Got command RPT from MCS: ref #1235060
2019-01-21 04:23:36 [DEBUG   ] summary = ERROR
2019-01-21 04:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235060  13 58504 15816449 A  ERRORERROR'
2019-01-21 04:23:36 [DEBUG   ] Got command RPT from MCS: ref #1235061
2019-01-21 04:23:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235061  77 58504 15816657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:23:36 [DEBUG   ] Got command RPT from MCS: ref #1235062
2019-01-21 04:23:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 04:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235062  12 58504 15816849 A  ERRORB—™š'
2019-01-21 04:23:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 04:24:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:24:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:24:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:24:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:24:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:24:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:24:01 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-21 04:24:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 04:24:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:24:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:25:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:25:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:25:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:25:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:25:01 [WARNING ] (13, 1, 'bot')
2019-01-21 04:25:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:25:01 [DEBUG   ] Finished updating board flags in 1.394 seconds
2019-01-21 04:25:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 04:25:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 04:25:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 04:26:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:26:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:26:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:26:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:26:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:26:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:26:02 [DEBUG   ] Finished updating board flags in 2.203 seconds
2019-01-21 04:26:06 [DEBUG   ] Got command RPT from MCS: ref #1235067
2019-01-21 04:26:06 [DEBUG   ] summary = ERROR
2019-01-21 04:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235067  13 58504 15966865 A  ERRORERROR'
2019-01-21 04:26:06 [DEBUG   ] Got command RPT from MCS: ref #1235068
2019-01-21 04:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235068  77 58504 15966866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:26:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 04:26:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 04:26:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 04:27:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:27:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:27:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:27:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:27:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:27:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:27:02 [DEBUG   ] Finished updating board flags in 2.200 seconds
2019-01-21 04:27:09 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-21 04:27:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:27:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 04:28:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:28:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:28:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:28:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:28:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:28:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:28:02 [DEBUG   ] Finished updating board flags in 2.001 seconds
2019-01-21 04:28:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 04:28:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 04:28:36 [DEBUG   ] Got command RPT from MCS: ref #1235086
2019-01-21 04:28:36 [DEBUG   ] summary = ERROR
2019-01-21 04:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235086  13 58504 16116137 A  ERRORERROR'
2019-01-21 04:28:36 [DEBUG   ] Got command RPT from MCS: ref #1235087
2019-01-21 04:28:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235087  77 58504 16116329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:28:36 [DEBUG   ] Got command RPT from MCS: ref #1235088
2019-01-21 04:28:36 [DEBUG   ] summary = ERROR
2019-01-21 04:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235088  13 58504 16116533 A  ERRORERROR'
2019-01-21 04:28:36 [DEBUG   ] Got command RPT from MCS: ref #1235090
2019-01-21 04:28:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235090  77 58504 16116737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:28:36 [DEBUG   ] Got command RPT from MCS: ref #1235091
2019-01-21 04:28:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 04:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235091  12 58504 16116929 A  ERRORB–™š'
2019-01-21 04:28:50 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 04:29:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:29:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:29:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:29:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:29:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:29:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:29:02 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-21 04:29:10 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-21 04:29:29 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2019-01-21 04:29:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 04:30:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:30:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:30:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:30:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:30:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:30:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:30:02 [DEBUG   ] Finished updating board flags in 2.044 seconds
2019-01-21 04:30:10 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 04:30:30 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 04:30:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 04:31:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:31:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:31:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:31:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:31:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:31:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:31:02 [DEBUG   ] Finished updating board flags in 1.954 seconds
2019-01-21 04:31:06 [DEBUG   ] Got command RPT from MCS: ref #1235100
2019-01-21 04:31:06 [DEBUG   ] summary = ERROR
2019-01-21 04:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235100  13 58504 16266865 A  ERRORERROR'
2019-01-21 04:31:06 [DEBUG   ] Got command RPT from MCS: ref #1235101
2019-01-21 04:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235101  77 58504 16266866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:31:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 04:31:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 04:31:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 04:32:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 04:32:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:32:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-21 04:32:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:32:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:32:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:32:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:32:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:32:02 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-21 04:32:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:32:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 04:32:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 04:33:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:33:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:33:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:33:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:33:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:33:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:33:02 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-01-21 04:33:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 04:33:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 04:33:36 [DEBUG   ] Got command RPT from MCS: ref #1235121
2019-01-21 04:33:36 [DEBUG   ] summary = ERROR
2019-01-21 04:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235121  13 58504 16416221 A  ERRORERROR'
2019-01-21 04:33:36 [DEBUG   ] Got command RPT from MCS: ref #1235122
2019-01-21 04:33:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235122  77 58504 16416427 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:33:36 [DEBUG   ] Got command RPT from MCS: ref #1235123
2019-01-21 04:33:36 [DEBUG   ] summary = ERROR
2019-01-21 04:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235123  13 58504 16416617 A  ERRORERROR'
2019-01-21 04:33:36 [DEBUG   ] Got command RPT from MCS: ref #1235124
2019-01-21 04:33:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235124  77 58504 16416821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:33:37 [DEBUG   ] Got command RPT from MCS: ref #1235125
2019-01-21 04:33:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 04:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235125  12 58504 16417025 A  ERRORB—™š'
2019-01-21 04:33:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 04:34:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:34:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:34:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:34:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:34:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:34:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:34:02 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-21 04:34:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 04:34:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 04:34:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:35:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:35:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 04:35:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:35:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:35:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:35:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:35:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:35:02 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-01-21 04:35:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 04:35:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 04:35:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 04:36:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:36:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:36:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:36:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:36:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:36:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:36:02 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-21 04:36:06 [DEBUG   ] Got command RPT from MCS: ref #1235130
2019-01-21 04:36:06 [DEBUG   ] summary = ERROR
2019-01-21 04:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235130  13 58504 16566869 A  ERRORERROR'
2019-01-21 04:36:06 [DEBUG   ] Got command RPT from MCS: ref #1235131
2019-01-21 04:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235131  77 58504 16566870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:36:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 04:36:31 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 04:36:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 04:37:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:37:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:37:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:37:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:37:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:37:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:37:02 [DEBUG   ] Finished updating board flags in 1.394 seconds
2019-01-21 04:37:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 04:37:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 04:37:51 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 04:38:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:38:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:38:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:38:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:38:02 [WARNING ] (13, 1, 'bot')
2019-01-21 04:38:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:38:02 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-01-21 04:38:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:38:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:38:36 [DEBUG   ] Got command RPT from MCS: ref #1235153
2019-01-21 04:38:36 [DEBUG   ] summary = ERROR
2019-01-21 04:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235153  13 58504 16716297 A  ERRORERROR'
2019-01-21 04:38:36 [DEBUG   ] Got command RPT from MCS: ref #1235154
2019-01-21 04:38:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235154  77 58504 16716501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:38:36 [DEBUG   ] Got command RPT from MCS: ref #1235155
2019-01-21 04:38:36 [DEBUG   ] summary = ERROR
2019-01-21 04:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235155  13 58504 16716705 A  ERRORERROR'
2019-01-21 04:38:36 [DEBUG   ] Got command RPT from MCS: ref #1235157
2019-01-21 04:38:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235157  77 58504 16716897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:38:37 [DEBUG   ] Got command RPT from MCS: ref #1235159
2019-01-21 04:38:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 04:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235159  12 58504 16717101 A  ERRORB—™š'
2019-01-21 04:38:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 04:39:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:39:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:39:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:39:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:39:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:39:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:39:03 [DEBUG   ] Finished updating board flags in 2.053 seconds
2019-01-21 04:39:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 04:39:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 04:39:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 04:40:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:40:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:40:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:40:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:40:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:40:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:40:03 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-01-21 04:40:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-21 04:40:32 [DEBUG   ] Finished updating ant stats in 1.798 seconds
2019-01-21 04:40:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:41:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:41:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:41:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:41:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:41:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:41:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:41:03 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-01-21 04:41:06 [DEBUG   ] Got command RPT from MCS: ref #1235167
2019-01-21 04:41:06 [DEBUG   ] summary = ERROR
2019-01-21 04:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235167  13 58504 16866869 A  ERRORERROR'
2019-01-21 04:41:06 [DEBUG   ] Got command RPT from MCS: ref #1235168
2019-01-21 04:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235168  77 58504 16866870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:41:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:41:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 04:41:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 04:42:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:42:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:42:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:42:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:42:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:42:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:42:03 [DEBUG   ] Finished updating board flags in 1.859 seconds
2019-01-21 04:42:12 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 04:42:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 04:42:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 04:43:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:43:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:43:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:43:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:43:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:43:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:43:03 [DEBUG   ] Finished updating board flags in 1.738 seconds
2019-01-21 04:43:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:43:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 04:43:36 [DEBUG   ] Got command RPT from MCS: ref #1235184
2019-01-21 04:43:36 [DEBUG   ] summary = ERROR
2019-01-21 04:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235184  13 58504 17016389 A  ERRORERROR'
2019-01-21 04:43:36 [DEBUG   ] Got command RPT from MCS: ref #1235185
2019-01-21 04:43:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235185  77 58504 17016593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:43:36 [DEBUG   ] Got command RPT from MCS: ref #1235186
2019-01-21 04:43:36 [DEBUG   ] summary = ERROR
2019-01-21 04:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235186  13 58504 17016797 A  ERRORERROR'
2019-01-21 04:43:36 [DEBUG   ] Got command RPT from MCS: ref #1235187
2019-01-21 04:43:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235187  77 58504 17016989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:43:37 [DEBUG   ] Got command RPT from MCS: ref #1235188
2019-01-21 04:43:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 04:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235188  12 58504 17017193 A  ERRORB–™š'
2019-01-21 04:43:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 04:44:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:44:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:44:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:44:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:44:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:44:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:44:03 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-21 04:44:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 04:44:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:44:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 04:45:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:45:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:45:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:45:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:45:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:45:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:45:03 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-21 04:45:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 04:45:32 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-21 04:45:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 04:46:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:46:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:46:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:46:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:46:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:46:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:46:03 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-21 04:46:06 [DEBUG   ] Got command RPT from MCS: ref #1235193
2019-01-21 04:46:06 [DEBUG   ] summary = ERROR
2019-01-21 04:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235193  13 58504 17166865 A  ERRORERROR'
2019-01-21 04:46:06 [DEBUG   ] Got command RPT from MCS: ref #1235194
2019-01-21 04:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235194  77 58504 17166866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:46:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 04:46:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 04:46:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 04:47:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-21 04:47:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:47:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:47:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:47:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:47:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:47:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:47:03 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-21 04:47:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:47:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 04:47:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 04:48:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:48:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:48:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:48:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:48:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:48:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:48:03 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-01-21 04:48:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 04:48:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 04:48:36 [DEBUG   ] Got command RPT from MCS: ref #1235216
2019-01-21 04:48:36 [DEBUG   ] summary = ERROR
2019-01-21 04:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235216  13 58504 17316473 A  ERRORERROR'
2019-01-21 04:48:36 [DEBUG   ] Got command RPT from MCS: ref #1235217
2019-01-21 04:48:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235217  77 58504 17316677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:48:36 [DEBUG   ] Got command RPT from MCS: ref #1235218
2019-01-21 04:48:36 [DEBUG   ] summary = ERROR
2019-01-21 04:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235218  13 58504 17316869 A  ERRORERROR'
2019-01-21 04:48:37 [DEBUG   ] Got command RPT from MCS: ref #1235220
2019-01-21 04:48:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235220  77 58504 17317073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:48:37 [DEBUG   ] Got command RPT from MCS: ref #1235221
2019-01-21 04:48:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 04:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235221  12 58504 17317277 A  ERRORB–™š'
2019-01-21 04:48:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 04:49:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:49:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:49:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:49:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:49:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:49:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:49:03 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-21 04:49:13 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-01-21 04:49:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:49:53 [DEBUG   ] Finished updating ant stats in 0.431 seconds
2019-01-21 04:50:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:50:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:50:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:50:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:50:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:50:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:50:03 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-01-21 04:50:14 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 04:50:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 04:50:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 04:51:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:51:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:51:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:51:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:51:03 [WARNING ] (13, 1, 'bot')
2019-01-21 04:51:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:51:03 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-01-21 04:51:06 [DEBUG   ] Got command RPT from MCS: ref #1235230
2019-01-21 04:51:06 [DEBUG   ] summary = ERROR
2019-01-21 04:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235230  13 58504 17466869 A  ERRORERROR'
2019-01-21 04:51:06 [DEBUG   ] Got command RPT from MCS: ref #1235231
2019-01-21 04:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235231  77 58504 17466870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:51:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 04:51:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 04:51:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 04:52:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:52:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:52:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:52:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:52:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:52:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:52:04 [DEBUG   ] Finished updating board flags in 2.053 seconds
2019-01-21 04:52:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 04:52:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 04:52:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 04:53:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:53:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:53:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:53:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:53:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:53:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:53:04 [DEBUG   ] Finished updating board flags in 2.018 seconds
2019-01-21 04:53:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 04:53:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 04:53:36 [DEBUG   ] Got command RPT from MCS: ref #1235251
2019-01-21 04:53:36 [DEBUG   ] summary = ERROR
2019-01-21 04:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235251  13 58504 17616561 A  ERRORERROR'
2019-01-21 04:53:36 [DEBUG   ] Got command RPT from MCS: ref #1235252
2019-01-21 04:53:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235252  77 58504 17616753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:53:36 [DEBUG   ] Got command RPT from MCS: ref #1235253
2019-01-21 04:53:36 [DEBUG   ] summary = ERROR
2019-01-21 04:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235253  13 58504 17616957 A  ERRORERROR'
2019-01-21 04:53:37 [DEBUG   ] Got command RPT from MCS: ref #1235254
2019-01-21 04:53:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235254  77 58504 17617161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:53:37 [DEBUG   ] Got command RPT from MCS: ref #1235255
2019-01-21 04:53:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 04:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235255  12 58504 17617365 A  ERRORB—™š'
2019-01-21 04:53:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 04:54:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:54:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:54:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:54:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:54:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:54:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:54:04 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-21 04:54:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 04:54:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 04:54:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 04:55:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 04:55:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:55:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:55:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:55:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:55:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:55:04 [DEBUG   ] Finished updating board flags in 1.963 seconds
2019-01-21 04:55:14 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-01-21 04:55:34 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-21 04:55:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 04:56:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:56:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:56:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:56:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:56:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:56:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:56:04 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-21 04:56:06 [DEBUG   ] Got command RPT from MCS: ref #1235260
2019-01-21 04:56:06 [DEBUG   ] summary = ERROR
2019-01-21 04:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235260  13 58504 17766877 A  ERRORERROR'
2019-01-21 04:56:06 [DEBUG   ] Got command RPT from MCS: ref #1235261
2019-01-21 04:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235261  77 58504 17766878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:56:15 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-21 04:56:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 04:56:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 04:57:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:57:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:57:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:57:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:57:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:57:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:57:04 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-21 04:57:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 04:57:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 04:57:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 04:58:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:58:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:58:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:58:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:58:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:58:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:58:04 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-21 04:58:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 04:58:35 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-21 04:58:36 [DEBUG   ] Got command RPT from MCS: ref #1235279
2019-01-21 04:58:36 [DEBUG   ] summary = ERROR
2019-01-21 04:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235279  13 58504 17916645 A  ERRORERROR'
2019-01-21 04:58:36 [DEBUG   ] Got command RPT from MCS: ref #1235280
2019-01-21 04:58:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235280  77 58504 17916849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:58:37 [DEBUG   ] Got command RPT from MCS: ref #1235281
2019-01-21 04:58:37 [DEBUG   ] summary = ERROR
2019-01-21 04:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235281  13 58504 17917041 A  ERRORERROR'
2019-01-21 04:58:37 [DEBUG   ] Got command RPT from MCS: ref #1235283
2019-01-21 04:58:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 04:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235283  77 58504 17917245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 04:58:37 [DEBUG   ] Got command RPT from MCS: ref #1235285
2019-01-21 04:58:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 04:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235285  12 58504 17917449 A  ERRORB–™š'
2019-01-21 04:58:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 04:59:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 04:59:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:59:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:59:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:59:04 [WARNING ] (13, 1, 'bot')
2019-01-21 04:59:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 04:59:04 [DEBUG   ] Finished updating board flags in 1.644 seconds
2019-01-21 04:59:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:59:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 04:59:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-21 05:00:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:00:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:00:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:00:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:00:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:00:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:00:04 [DEBUG   ] Finished updating board flags in 1.551 seconds
2019-01-21 05:00:15 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-21 05:00:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 05:00:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 05:01:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:01:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:01:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:01:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:01:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:01:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:01:04 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-21 05:01:06 [DEBUG   ] Got command RPT from MCS: ref #1235293
2019-01-21 05:01:06 [DEBUG   ] summary = ERROR
2019-01-21 05:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235293  13 58504 18066877 A  ERRORERROR'
2019-01-21 05:01:06 [DEBUG   ] Got command RPT from MCS: ref #1235294
2019-01-21 05:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235294  77 58504 18066878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:01:16 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 05:01:36 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 05:01:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 05:02:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:02:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 05:02:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:02:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:02:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:02:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:02:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:02:04 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-01-21 05:02:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 05:02:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 05:02:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 05:03:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:03:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:03:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:03:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:03:04 [WARNING ] (13, 1, 'bot')
2019-01-21 05:03:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:03:04 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-01-21 05:03:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 05:03:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 05:03:36 [DEBUG   ] Got command RPT from MCS: ref #1235314
2019-01-21 05:03:36 [DEBUG   ] summary = ERROR
2019-01-21 05:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235314  13 58504 18216725 A  ERRORERROR'
2019-01-21 05:03:36 [DEBUG   ] Got command RPT from MCS: ref #1235315
2019-01-21 05:03:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235315  77 58504 18216929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:03:37 [DEBUG   ] Got command RPT from MCS: ref #1235316
2019-01-21 05:03:37 [DEBUG   ] summary = ERROR
2019-01-21 05:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235316  13 58504 18217133 A  ERRORERROR'
2019-01-21 05:03:37 [DEBUG   ] Got command RPT from MCS: ref #1235317
2019-01-21 05:03:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235317  77 58504 18217325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:03:37 [DEBUG   ] Got command RPT from MCS: ref #1235318
2019-01-21 05:03:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 05:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235318  12 58504 18217529 A  ERRORB–™š'
2019-01-21 05:03:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 05:04:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:04:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:04:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:04:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:04:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:04:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:04:05 [DEBUG   ] Finished updating board flags in 2.061 seconds
2019-01-21 05:04:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 05:04:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 05:04:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 05:05:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:05:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:05:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:05:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:05:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:05:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:05:05 [DEBUG   ] Finished updating board flags in 1.977 seconds
2019-01-21 05:05:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 05:05:36 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 05:05:57 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 05:06:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:06:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:06:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:06:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:06:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:06:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:06:05 [DEBUG   ] Finished updating board flags in 1.805 seconds
2019-01-21 05:06:06 [DEBUG   ] Got command RPT from MCS: ref #1235323
2019-01-21 05:06:06 [DEBUG   ] summary = ERROR
2019-01-21 05:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235323  13 58504 18366869 A  ERRORERROR'
2019-01-21 05:06:06 [DEBUG   ] Got command RPT from MCS: ref #1235324
2019-01-21 05:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235324  77 58504 18366870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:06:17 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 05:06:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 05:06:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 05:07:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:07:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:07:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:07:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:07:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:07:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:07:05 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-21 05:07:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 05:07:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 05:07:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 05:08:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 05:08:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:08:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:08:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:08:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:08:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:08:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:08:05 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-21 05:08:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 05:08:36 [DEBUG   ] Got command RPT from MCS: ref #1235346
2019-01-21 05:08:36 [DEBUG   ] summary = ERROR
2019-01-21 05:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235346  13 58504 18516817 A  ERRORERROR'
2019-01-21 05:08:37 [DEBUG   ] Got command RPT from MCS: ref #1235347
2019-01-21 05:08:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235347  77 58504 18517009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:08:37 [DEBUG   ] Got command RPT from MCS: ref #1235348
2019-01-21 05:08:37 [DEBUG   ] summary = ERROR
2019-01-21 05:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235348  13 58504 18517213 A  ERRORERROR'
2019-01-21 05:08:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 05:08:37 [DEBUG   ] Got command RPT from MCS: ref #1235350
2019-01-21 05:08:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235350  77 58504 18517417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:08:37 [DEBUG   ] Got command RPT from MCS: ref #1235351
2019-01-21 05:08:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 05:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235351  12 58504 18517621 A  ERRORB—™š'
2019-01-21 05:08:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 05:09:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:09:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:09:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:09:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:09:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:09:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:09:05 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-01-21 05:09:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 05:09:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 05:09:57 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-21 05:10:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:10:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 05:10:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 05:10:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:10:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:10:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:10:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:10:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:10:05 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-21 05:10:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 05:10:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 05:10:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 05:11:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:11:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:11:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:11:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:11:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:11:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:11:05 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-01-21 05:11:06 [DEBUG   ] Got command RPT from MCS: ref #1235360
2019-01-21 05:11:06 [DEBUG   ] summary = ERROR
2019-01-21 05:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235360  13 58504 18666877 A  ERRORERROR'
2019-01-21 05:11:06 [DEBUG   ] Got command RPT from MCS: ref #1235361
2019-01-21 05:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235361  77 58504 18666878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:11:11 [DEBUG   ] Got command TBW from MCS: ref #1235378
2019-01-21 05:11:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-21 05:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1235378   8 58504 18671741 A  ERROR'
2019-01-21 05:11:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-21 05:11:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-21 05:11:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-21 05:11:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-21 05:11:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-21 05:11:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-21 05:11:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-21 05:11:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-21 05:11:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-21 05:11:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-21 05:11:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-21 05:11:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-21 05:11:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-21 05:11:15 [DEBUG   ] spawn_process: at 2019-01-21 05:11:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-21 05:11:15 [INFO    ] Finished spawning TBW
2019-01-21 05:12:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:12:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 05:12:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:12:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:12:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:12:05 [WARNING ] (13, 1, 'bot')
2019-01-21 05:12:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:12:05 [DEBUG   ] Finished updating board flags in 1.278 seconds
2019-01-21 05:13:03 [INFO    ] __waitForTBW - TBW finished in 108.576 s
2019-01-21 05:13:04 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2019-01-21 05:13:04 [INFO    ] Started antennas statistics background thread
2019-01-21 05:13:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1548047586']
2019-01-21 05:13:04 [DEBUG   ] spawn_process: at 2019-01-21 05:13:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1548047586']
2019-01-21 05:13:04 [INFO    ] Finished spawning TBN in 0.050 s
2019-01-21 05:13:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:13:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:13:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:13:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:13:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:13:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:13:06 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-01-21 05:13:24 [DEBUG   ] Finished updating ant stats in 0.467 seconds
2019-01-21 05:13:36 [DEBUG   ] Got command RPT from MCS: ref #1235384
2019-01-21 05:13:36 [DEBUG   ] summary = ERROR
2019-01-21 05:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235384  13 58504 18816897 A  ERRORERROR'
2019-01-21 05:13:37 [DEBUG   ] Got command RPT from MCS: ref #1235385
2019-01-21 05:13:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235385  77 58504 18817101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:13:37 [DEBUG   ] Got command RPT from MCS: ref #1235386
2019-01-21 05:13:37 [DEBUG   ] summary = ERROR
2019-01-21 05:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235386  13 58504 18817305 A  ERRORERROR'
2019-01-21 05:13:37 [DEBUG   ] Got command RPT from MCS: ref #1235387
2019-01-21 05:13:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235387  77 58504 18817497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:13:37 [DEBUG   ] Got command RPT from MCS: ref #1235388
2019-01-21 05:13:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 05:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235388  12 58504 18817708 A  ERRORB–™š'
2019-01-21 05:13:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 05:14:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-21 05:14:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:14:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:14:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:14:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:14:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:14:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:14:06 [DEBUG   ] Finished updating board flags in 2.242 seconds
2019-01-21 05:14:25 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2019-01-21 05:14:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 05:15:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 05:15:05 [DEBUG   ] Finished updating ant stats in 1.261 seconds
2019-01-21 05:15:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 05:15:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:15:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:15:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:15:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:15:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:15:06 [DEBUG   ] Finished updating board flags in 2.070 seconds
2019-01-21 05:15:25 [DEBUG   ] Finished updating ant stats in 1.144 seconds
2019-01-21 05:15:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 05:16:05 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2019-01-21 05:16:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 05:16:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:16:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:16:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:16:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:16:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:16:06 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-21 05:16:06 [DEBUG   ] Got command RPT from MCS: ref #1235395
2019-01-21 05:16:06 [DEBUG   ] summary = ERROR
2019-01-21 05:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235395  13 58504 18966881 A  ERRORERROR'
2019-01-21 05:16:06 [DEBUG   ] Got command RPT from MCS: ref #1235396
2019-01-21 05:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235396  77 58504 18966882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:16:25 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2019-01-21 05:16:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 05:17:05 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2019-01-21 05:17:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 05:17:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:17:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:17:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:17:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:17:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:17:06 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-21 05:17:25 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2019-01-21 05:17:45 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-21 05:18:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 05:18:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:18:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 05:18:06 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-21 05:18:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:18:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:18:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:18:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:18:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:18:06 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-21 05:18:26 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 05:18:36 [DEBUG   ] Got command RPT from MCS: ref #1235418
2019-01-21 05:18:36 [DEBUG   ] summary = ERROR
2019-01-21 05:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235418  13 58504 19116989 A  ERRORERROR'
2019-01-21 05:18:37 [DEBUG   ] Got command RPT from MCS: ref #1235419
2019-01-21 05:18:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235419  77 58504 19117193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:18:37 [DEBUG   ] Got command RPT from MCS: ref #1235420
2019-01-21 05:18:37 [DEBUG   ] summary = ERROR
2019-01-21 05:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235420  13 58504 19117385 A  ERRORERROR'
2019-01-21 05:18:37 [DEBUG   ] Got command RPT from MCS: ref #1235422
2019-01-21 05:18:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235422  77 58504 19117589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:18:37 [DEBUG   ] Got command RPT from MCS: ref #1235424
2019-01-21 05:18:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 05:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235424  12 58504 19117793 A  ERRORB˜™š'
2019-01-21 05:18:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 05:19:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:19:06 [DEBUG   ] Finished updating ant stats in 1.244 seconds
2019-01-21 05:19:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:19:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:19:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:19:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:19:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:19:06 [DEBUG   ] Finished updating board flags in 1.850 seconds
2019-01-21 05:19:26 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2019-01-21 05:19:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 05:20:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 05:20:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:20:06 [DEBUG   ] Finished updating ant stats in 1.041 seconds
2019-01-21 05:20:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:20:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:20:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:20:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:20:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:20:06 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-21 05:20:26 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2019-01-21 05:20:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 05:21:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:21:06 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2019-01-21 05:21:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:21:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:21:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:21:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:21:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:21:06 [DEBUG   ] Finished updating board flags in 1.776 seconds
2019-01-21 05:21:06 [DEBUG   ] Got command RPT from MCS: ref #1235432
2019-01-21 05:21:06 [DEBUG   ] summary = ERROR
2019-01-21 05:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235432  13 58504 19266877 A  ERRORERROR'
2019-01-21 05:21:06 [DEBUG   ] Got command RPT from MCS: ref #1235433
2019-01-21 05:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235433  77 58504 19266878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:21:26 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2019-01-21 05:21:47 [DEBUG   ] Finished updating ant stats in 1.599 seconds
2019-01-21 05:22:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:22:06 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2019-01-21 05:22:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:22:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:22:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:22:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:22:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:22:06 [DEBUG   ] Finished updating board flags in 1.634 seconds
2019-01-21 05:22:27 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2019-01-21 05:22:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 05:23:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:23:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:23:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:23:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:23:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:23:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:23:06 [DEBUG   ] Finished updating board flags in 1.563 seconds
2019-01-21 05:23:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 05:23:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 05:23:37 [DEBUG   ] Got command RPT from MCS: ref #1235453
2019-01-21 05:23:37 [DEBUG   ] summary = ERROR
2019-01-21 05:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235453  13 58504 19417077 A  ERRORERROR'
2019-01-21 05:23:37 [DEBUG   ] Got command RPT from MCS: ref #1235454
2019-01-21 05:23:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235454  77 58504 19417269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:23:37 [DEBUG   ] Got command RPT from MCS: ref #1235455
2019-01-21 05:23:37 [DEBUG   ] summary = ERROR
2019-01-21 05:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235455  13 58504 19417473 A  ERRORERROR'
2019-01-21 05:23:37 [DEBUG   ] Got command RPT from MCS: ref #1235456
2019-01-21 05:23:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235456  77 58504 19417696 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:23:37 [DEBUG   ] Got command RPT from MCS: ref #1235457
2019-01-21 05:23:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 05:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235457  12 58504 19417874 A  ERRORB—™š'
2019-01-21 05:23:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 05:24:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:24:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:24:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:24:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:24:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:24:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:24:06 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-21 05:24:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 05:24:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 05:24:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 05:25:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:25:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:25:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:25:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:25:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:25:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:25:06 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-21 05:25:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 05:25:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 05:25:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 05:26:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:26:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:26:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:26:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:26:06 [WARNING ] (13, 1, 'bot')
2019-01-21 05:26:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:26:06 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-01-21 05:26:06 [DEBUG   ] Got command RPT from MCS: ref #1235462
2019-01-21 05:26:06 [DEBUG   ] summary = ERROR
2019-01-21 05:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235462  13 58504 19566873 A  ERRORERROR'
2019-01-21 05:26:06 [DEBUG   ] Got command RPT from MCS: ref #1235463
2019-01-21 05:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235463  77 58504 19566874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:26:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 05:26:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 05:26:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 05:27:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:27:07 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2019-01-21 05:27:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:27:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:27:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:27:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:27:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:27:07 [DEBUG   ] Finished updating board flags in 2.273 seconds
2019-01-21 05:27:28 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2019-01-21 05:27:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 05:28:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:28:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:28:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:28:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:28:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:28:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:28:07 [DEBUG   ] Finished updating board flags in 2.155 seconds
2019-01-21 05:28:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 05:28:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 05:28:37 [DEBUG   ] Got command RPT from MCS: ref #1235481
2019-01-21 05:28:37 [DEBUG   ] summary = ERROR
2019-01-21 05:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235481  13 58504 19717153 A  ERRORERROR'
2019-01-21 05:28:37 [DEBUG   ] Got command RPT from MCS: ref #1235482
2019-01-21 05:28:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235482  77 58504 19717357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:28:37 [DEBUG   ] Got command RPT from MCS: ref #1235483
2019-01-21 05:28:37 [DEBUG   ] summary = ERROR
2019-01-21 05:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235483  13 58504 19717561 A  ERRORERROR'
2019-01-21 05:28:37 [DEBUG   ] Got command RPT from MCS: ref #1235485
2019-01-21 05:28:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235485  77 58504 19717765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:28:37 [DEBUG   ] Got command RPT from MCS: ref #1235486
2019-01-21 05:28:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 05:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235486  12 58504 19717957 A  ERRORB–™š'
2019-01-21 05:28:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 05:29:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:29:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:29:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:29:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:29:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:29:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:29:07 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-01-21 05:29:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 05:29:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 05:29:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 05:30:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:30:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:30:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:30:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:30:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:30:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:30:07 [DEBUG   ] Finished updating board flags in 1.995 seconds
2019-01-21 05:30:08 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-21 05:30:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 05:30:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 05:31:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:31:06 [DEBUG   ] Got command RPT from MCS: ref #1235495
2019-01-21 05:31:06 [DEBUG   ] summary = ERROR
2019-01-21 05:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235495  13 58504 19866881 A  ERRORERROR'
2019-01-21 05:31:06 [DEBUG   ] Got command RPT from MCS: ref #1235496
2019-01-21 05:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235496  77 58504 19866882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:31:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:31:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:31:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:31:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:31:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:31:07 [DEBUG   ] Finished updating board flags in 1.773 seconds
2019-01-21 05:31:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 05:31:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 05:31:49 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-21 05:32:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 05:32:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:32:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:32:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:32:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:32:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:32:07 [DEBUG   ] Finished updating board flags in 1.580 seconds
2019-01-21 05:32:09 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 05:32:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 05:32:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 05:33:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:33:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:33:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:33:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:33:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:33:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:33:07 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-01-21 05:33:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 05:33:29 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-21 05:33:37 [DEBUG   ] Got command RPT from MCS: ref #1235516
2019-01-21 05:33:37 [DEBUG   ] summary = ERROR
2019-01-21 05:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235516  13 58504 20017245 A  ERRORERROR'
2019-01-21 05:33:37 [DEBUG   ] Got command RPT from MCS: ref #1235517
2019-01-21 05:33:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235517  77 58504 20017449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:33:37 [DEBUG   ] Got command RPT from MCS: ref #1235518
2019-01-21 05:33:37 [DEBUG   ] summary = ERROR
2019-01-21 05:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235518  13 58504 20017641 A  ERRORERROR'
2019-01-21 05:33:37 [DEBUG   ] Got command RPT from MCS: ref #1235519
2019-01-21 05:33:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235519  77 58504 20017845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:33:38 [DEBUG   ] Got command RPT from MCS: ref #1235520
2019-01-21 05:33:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 05:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235520  12 58504 20018049 A  ERRORB•™š'
2019-01-21 05:33:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 05:34:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:34:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:34:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:34:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:34:07 [WARNING ] (13, 1, 'bot')
2019-01-21 05:34:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:34:07 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-21 05:34:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 05:34:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 05:34:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 05:35:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:35:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:35:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:35:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:35:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:35:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:35:08 [DEBUG   ] Finished updating board flags in 2.209 seconds
2019-01-21 05:35:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 05:35:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 05:35:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 05:36:06 [DEBUG   ] Got command RPT from MCS: ref #1235525
2019-01-21 05:36:06 [DEBUG   ] summary = ERROR
2019-01-21 05:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235525  13 58504 20166877 A  ERRORERROR'
2019-01-21 05:36:06 [DEBUG   ] Got command RPT from MCS: ref #1235526
2019-01-21 05:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235526  77 58504 20166878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:36:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:36:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:36:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:36:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:36:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:36:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:36:08 [DEBUG   ] Finished updating board flags in 2.183 seconds
2019-01-21 05:36:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 05:36:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 05:36:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 05:37:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:37:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:37:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:37:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:37:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:37:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:37:08 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-01-21 05:37:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 05:37:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 05:37:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 05:38:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:38:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:38:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:38:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:38:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:38:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:38:08 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-21 05:38:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 05:38:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 05:38:37 [DEBUG   ] Got command RPT from MCS: ref #1235548
2019-01-21 05:38:37 [DEBUG   ] summary = ERROR
2019-01-21 05:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235548  13 58504 20317329 A  ERRORERROR'
2019-01-21 05:38:37 [DEBUG   ] Got command RPT from MCS: ref #1235549
2019-01-21 05:38:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235549  77 58504 20317533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:38:37 [DEBUG   ] Got command RPT from MCS: ref #1235550
2019-01-21 05:38:37 [DEBUG   ] summary = ERROR
2019-01-21 05:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235550  13 58504 20317737 A  ERRORERROR'
2019-01-21 05:38:37 [DEBUG   ] Got command RPT from MCS: ref #1235552
2019-01-21 05:38:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235552  77 58504 20317929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:38:38 [DEBUG   ] Got command RPT from MCS: ref #1235554
2019-01-21 05:38:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 05:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235554  12 58504 20318133 A  ERRORB—™š'
2019-01-21 05:38:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 05:39:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:39:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:39:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:39:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:39:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:39:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:39:08 [DEBUG   ] Finished updating board flags in 1.860 seconds
2019-01-21 05:39:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 05:39:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 05:39:50 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-21 05:40:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 05:40:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:40:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:40:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:40:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:40:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:40:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:40:08 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-01-21 05:40:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 05:40:30 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-21 05:40:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 05:41:06 [DEBUG   ] Got command RPT from MCS: ref #1235562
2019-01-21 05:41:06 [DEBUG   ] summary = ERROR
2019-01-21 05:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235562  13 58504 20466881 A  ERRORERROR'
2019-01-21 05:41:06 [DEBUG   ] Got command RPT from MCS: ref #1235563
2019-01-21 05:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235563  77 58504 20466882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:41:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-21 05:41:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:41:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:41:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:41:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:41:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:41:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:41:08 [DEBUG   ] Finished updating board flags in 1.736 seconds
2019-01-21 05:41:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 05:41:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 05:41:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 05:42:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:42:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:42:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:42:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:42:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:42:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:42:08 [DEBUG   ] Finished updating board flags in 1.669 seconds
2019-01-21 05:42:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 05:42:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 05:42:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 05:43:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:43:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:43:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:43:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:43:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:43:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:43:08 [DEBUG   ] Finished updating board flags in 1.540 seconds
2019-01-21 05:43:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 05:43:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 05:43:37 [DEBUG   ] Got command RPT from MCS: ref #1235579
2019-01-21 05:43:37 [DEBUG   ] summary = ERROR
2019-01-21 05:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235579  13 58504 20617425 A  ERRORERROR'
2019-01-21 05:43:37 [DEBUG   ] Got command RPT from MCS: ref #1235580
2019-01-21 05:43:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235580  77 58504 20617617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:43:37 [DEBUG   ] Got command RPT from MCS: ref #1235581
2019-01-21 05:43:37 [DEBUG   ] summary = ERROR
2019-01-21 05:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235581  13 58504 20617830 A  ERRORERROR'
2019-01-21 05:43:38 [DEBUG   ] Got command RPT from MCS: ref #1235582
2019-01-21 05:43:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235582  77 58504 20618021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:43:38 [DEBUG   ] Got command RPT from MCS: ref #1235583
2019-01-21 05:43:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 05:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235583  12 58504 20618225 A  ERRORB—™š'
2019-01-21 05:43:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 05:44:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:44:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:44:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:44:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:44:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:44:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:44:08 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-21 05:44:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 05:44:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-21 05:44:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 05:45:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:45:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:45:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:45:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:45:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:45:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:45:08 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-21 05:45:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 05:45:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 05:45:51 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-21 05:46:06 [DEBUG   ] Got command RPT from MCS: ref #1235588
2019-01-21 05:46:06 [DEBUG   ] summary = ERROR
2019-01-21 05:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235588  13 58504 20766877 A  ERRORERROR'
2019-01-21 05:46:06 [DEBUG   ] Got command RPT from MCS: ref #1235589
2019-01-21 05:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235589  77 58504 20766878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:46:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:46:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:46:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:46:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:46:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:46:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:46:08 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-21 05:46:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 05:46:32 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-21 05:46:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 05:47:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:47:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:47:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:47:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:47:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:47:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:47:08 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-21 05:47:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-21 05:47:32 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-21 05:47:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 05:48:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:48:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:48:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:48:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:48:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:48:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:48:08 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-21 05:48:12 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 05:48:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 05:48:37 [DEBUG   ] Got command RPT from MCS: ref #1235611
2019-01-21 05:48:37 [DEBUG   ] summary = ERROR
2019-01-21 05:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235611  13 58504 20917509 A  ERRORERROR'
2019-01-21 05:48:37 [DEBUG   ] Got command RPT from MCS: ref #1235612
2019-01-21 05:48:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235612  77 58504 20917701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:48:37 [DEBUG   ] Got command RPT from MCS: ref #1235613
2019-01-21 05:48:37 [DEBUG   ] summary = ERROR
2019-01-21 05:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235613  13 58504 20917905 A  ERRORERROR'
2019-01-21 05:48:38 [DEBUG   ] Got command RPT from MCS: ref #1235615
2019-01-21 05:48:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235615  77 58504 20918109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:48:38 [DEBUG   ] Got command RPT from MCS: ref #1235616
2019-01-21 05:48:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 05:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235616  12 58504 20918313 A  ERRORB–™š'
2019-01-21 05:48:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 05:49:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:49:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:49:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:49:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:49:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:49:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:49:08 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-21 05:49:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 05:49:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 05:49:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 05:50:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:50:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 05:50:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:50:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:50:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:50:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:50:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:50:08 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-21 05:50:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 05:50:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 05:50:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 05:51:06 [DEBUG   ] Got command RPT from MCS: ref #1235625
2019-01-21 05:51:06 [DEBUG   ] summary = ERROR
2019-01-21 05:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235625  13 58504 21066877 A  ERRORERROR'
2019-01-21 05:51:06 [DEBUG   ] Got command RPT from MCS: ref #1235626
2019-01-21 05:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235626  77 58504 21066878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:51:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:51:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:51:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:51:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:51:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:51:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:51:08 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-21 05:51:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 05:51:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 05:51:52 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-21 05:52:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:52:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:52:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:52:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:52:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:52:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:52:08 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-01-21 05:52:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 05:52:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 05:52:53 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 05:53:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:53:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:53:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:53:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:53:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:53:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:53:08 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-01-21 05:53:13 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 05:53:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 05:53:37 [DEBUG   ] Got command RPT from MCS: ref #1235646
2019-01-21 05:53:37 [DEBUG   ] summary = ERROR
2019-01-21 05:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235646  13 58504 21217589 A  ERRORERROR'
2019-01-21 05:53:37 [DEBUG   ] Got command RPT from MCS: ref #1235647
2019-01-21 05:53:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235647  77 58504 21217793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:53:37 [DEBUG   ] Got command RPT from MCS: ref #1235648
2019-01-21 05:53:37 [DEBUG   ] summary = ERROR
2019-01-21 05:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235648  13 58504 21217997 A  ERRORERROR'
2019-01-21 05:53:38 [DEBUG   ] Got command RPT from MCS: ref #1235649
2019-01-21 05:53:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235649  77 58504 21218189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:53:38 [DEBUG   ] Got command RPT from MCS: ref #1235650
2019-01-21 05:53:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 05:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235650  12 58504 21218393 A  ERRORB–™š'
2019-01-21 05:53:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 05:54:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:54:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:54:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:54:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:54:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:54:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:54:08 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-01-21 05:54:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 05:54:33 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-21 05:54:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 05:55:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:55:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:55:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:55:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:55:08 [WARNING ] (13, 1, 'bot')
2019-01-21 05:55:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:55:08 [DEBUG   ] Finished updating board flags in 1.458 seconds
2019-01-21 05:55:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 05:55:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 05:55:53 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-21 05:56:06 [DEBUG   ] Got command RPT from MCS: ref #1235655
2019-01-21 05:56:06 [DEBUG   ] summary = ERROR
2019-01-21 05:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235655  13 58504 21366889 A  ERRORERROR'
2019-01-21 05:56:06 [DEBUG   ] Got command RPT from MCS: ref #1235656
2019-01-21 05:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235656  77 58504 21366890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:56:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:56:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:56:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:56:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:56:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:56:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:56:09 [DEBUG   ] Finished updating board flags in 2.223 seconds
2019-01-21 05:56:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 05:56:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 05:56:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 05:57:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 05:57:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:57:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:57:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:57:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:57:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:57:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:57:09 [DEBUG   ] Finished updating board flags in 2.173 seconds
2019-01-21 05:57:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 05:57:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 05:57:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 05:58:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:58:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:58:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:58:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:58:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:58:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:58:09 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-21 05:58:14 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 05:58:33 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-21 05:58:37 [DEBUG   ] Got command RPT from MCS: ref #1235674
2019-01-21 05:58:37 [DEBUG   ] summary = ERROR
2019-01-21 05:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235674  13 58504 21517673 A  ERRORERROR'
2019-01-21 05:58:37 [DEBUG   ] Got command RPT from MCS: ref #1235675
2019-01-21 05:58:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235675  77 58504 21517877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:58:38 [DEBUG   ] Got command RPT from MCS: ref #1235676
2019-01-21 05:58:38 [DEBUG   ] summary = ERROR
2019-01-21 05:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235676  13 58504 21518081 A  ERRORERROR'
2019-01-21 05:58:38 [DEBUG   ] Got command RPT from MCS: ref #1235678
2019-01-21 05:58:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 05:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235678  77 58504 21518285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 05:58:38 [DEBUG   ] Got command RPT from MCS: ref #1235679
2019-01-21 05:58:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 05:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235679  12 58504 21518477 A  ERRORB—™š'
2019-01-21 05:58:54 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-21 05:59:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 05:59:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:59:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:59:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:59:09 [WARNING ] (13, 1, 'bot')
2019-01-21 05:59:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 05:59:09 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-01-21 05:59:14 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 05:59:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 05:59:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 06:00:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:00:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:00:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:00:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:00:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:00:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:00:09 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-21 06:00:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 06:00:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 06:00:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 06:01:06 [DEBUG   ] Got command RPT from MCS: ref #1235688
2019-01-21 06:01:06 [DEBUG   ] summary = ERROR
2019-01-21 06:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235688  13 58504 21666885 A  ERRORERROR'
2019-01-21 06:01:06 [DEBUG   ] Got command RPT from MCS: ref #1235689
2019-01-21 06:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235689  77 58504 21666886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:01:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:01:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:01:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:01:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:01:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:01:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:01:09 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-21 06:01:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 06:01:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 06:01:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 06:02:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:02:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:02:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:02:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:02:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:02:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:02:09 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-21 06:02:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 06:02:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 06:02:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 06:03:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:03:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:03:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:03:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:03:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:03:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:03:09 [DEBUG   ] Finished updating board flags in 1.599 seconds
2019-01-21 06:03:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 06:03:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 06:03:37 [DEBUG   ] Got command RPT from MCS: ref #1235709
2019-01-21 06:03:37 [DEBUG   ] summary = ERROR
2019-01-21 06:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235709  13 58504 21817769 A  ERRORERROR'
2019-01-21 06:03:37 [DEBUG   ] Got command RPT from MCS: ref #1235710
2019-01-21 06:03:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235710  77 58504 21817961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:03:38 [DEBUG   ] Got command RPT from MCS: ref #1235711
2019-01-21 06:03:38 [DEBUG   ] summary = ERROR
2019-01-21 06:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235711  13 58504 21818165 A  ERRORERROR'
2019-01-21 06:03:38 [DEBUG   ] Got command RPT from MCS: ref #1235712
2019-01-21 06:03:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235712  77 58504 21818369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:03:38 [DEBUG   ] Got command RPT from MCS: ref #1235713
2019-01-21 06:03:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 06:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235713  12 58504 21818573 A  ERRORB–™š'
2019-01-21 06:03:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 06:04:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:04:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:04:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:04:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:04:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:04:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:04:09 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-21 06:04:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 06:04:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 06:04:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 06:05:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:05:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-01-21 06:05:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:05:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:05:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:05:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:05:09 [WARNING ] (25, 5, 'bot')
2019-01-21 06:05:09 [WARNING ] (25, 5, 'bot')
2019-01-21 06:05:09 [WARNING ] (25, 5, 'bot')
2019-01-21 06:05:09 [WARNING ] (25, 5, 'bot')
2019-01-21 06:05:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:05:09 [DEBUG   ] Finished updating board flags in 1.384 seconds
2019-01-21 06:05:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 06:05:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 06:05:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 06:06:06 [DEBUG   ] Got command RPT from MCS: ref #1235718
2019-01-21 06:06:06 [DEBUG   ] summary = ERROR
2019-01-21 06:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235718  13 58504 21966885 A  ERRORERROR'
2019-01-21 06:06:06 [DEBUG   ] Got command RPT from MCS: ref #1235719
2019-01-21 06:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235719  77 58504 21966886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:06:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:06:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 06:06:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:06:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:06:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:06:09 [WARNING ] (13, 1, 'bot')
2019-01-21 06:06:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:06:09 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-21 06:06:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 06:06:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 06:06:55 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-21 06:07:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:07:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:07:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:07:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:07:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:07:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:07:10 [DEBUG   ] Finished updating board flags in 2.043 seconds
2019-01-21 06:07:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 06:07:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 06:07:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 06:08:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:08:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:08:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:08:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:08:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:08:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:08:10 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-01-21 06:08:15 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-21 06:08:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 06:08:37 [DEBUG   ] Got command RPT from MCS: ref #1235741
2019-01-21 06:08:37 [DEBUG   ] summary = ERROR
2019-01-21 06:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235741  13 58504 22117849 A  ERRORERROR'
2019-01-21 06:08:38 [DEBUG   ] Got command RPT from MCS: ref #1235742
2019-01-21 06:08:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235742  77 58504 22118053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:08:38 [DEBUG   ] Got command RPT from MCS: ref #1235743
2019-01-21 06:08:38 [DEBUG   ] summary = ERROR
2019-01-21 06:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235743  13 58504 22118245 A  ERRORERROR'
2019-01-21 06:08:38 [DEBUG   ] Got command RPT from MCS: ref #1235745
2019-01-21 06:08:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235745  77 58504 22118449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:08:38 [DEBUG   ] Got command RPT from MCS: ref #1235747
2019-01-21 06:08:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 06:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235747  12 58504 22118653 A  ERRORB•™š'
2019-01-21 06:08:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 06:09:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:09:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:09:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:09:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:09:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:09:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:09:10 [DEBUG   ] Finished updating board flags in 1.805 seconds
2019-01-21 06:09:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 06:09:35 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-21 06:09:56 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-21 06:10:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 06:10:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:10:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 06:10:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:10:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:10:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:10:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:10:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:10:10 [DEBUG   ] Finished updating board flags in 1.832 seconds
2019-01-21 06:10:16 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 06:10:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 06:10:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 06:11:06 [DEBUG   ] Got command RPT from MCS: ref #1235755
2019-01-21 06:11:06 [DEBUG   ] summary = ERROR
2019-01-21 06:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235755  13 58504 22266885 A  ERRORERROR'
2019-01-21 06:11:06 [DEBUG   ] Got command RPT from MCS: ref #1235756
2019-01-21 06:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235756  77 58504 22266886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:11:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 06:11:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:11:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:11:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:11:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:11:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:11:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:11:10 [DEBUG   ] Finished updating board flags in 1.758 seconds
2019-01-21 06:11:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 06:11:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 06:11:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 06:12:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 06:12:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:12:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:12:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:12:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:12:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:12:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:12:10 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-21 06:12:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 06:12:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 06:12:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 06:13:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 06:13:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:13:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:13:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:13:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:13:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:13:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:13:10 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-01-21 06:13:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 06:13:37 [DEBUG   ] Finished updating ant stats in 1.797 seconds
2019-01-21 06:13:37 [DEBUG   ] Got command RPT from MCS: ref #1235772
2019-01-21 06:13:37 [DEBUG   ] summary = ERROR
2019-01-21 06:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235772  13 58504 22417937 A  ERRORERROR'
2019-01-21 06:13:38 [DEBUG   ] Got command RPT from MCS: ref #1235773
2019-01-21 06:13:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235773  77 58504 22418141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:13:38 [DEBUG   ] Got command RPT from MCS: ref #1235774
2019-01-21 06:13:38 [DEBUG   ] summary = ERROR
2019-01-21 06:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235774  13 58504 22418334 A  ERRORERROR'
2019-01-21 06:13:38 [DEBUG   ] Got command RPT from MCS: ref #1235775
2019-01-21 06:13:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235775  77 58504 22418538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:13:38 [DEBUG   ] Got command RPT from MCS: ref #1235776
2019-01-21 06:13:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 06:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235776  12 58504 22418741 A  ERRORB—™š'
2019-01-21 06:13:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 06:14:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:14:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 06:14:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:14:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:14:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:14:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:14:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:14:10 [DEBUG   ] Finished updating board flags in 1.444 seconds
2019-01-21 06:14:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 06:14:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 06:14:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 06:15:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:15:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:15:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:15:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:15:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:15:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:15:10 [DEBUG   ] Finished updating board flags in 1.370 seconds
2019-01-21 06:15:17 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-21 06:15:36 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-21 06:15:57 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-21 06:16:06 [DEBUG   ] Got command RPT from MCS: ref #1235781
2019-01-21 06:16:06 [DEBUG   ] summary = ERROR
2019-01-21 06:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235781  13 58504 22566885 A  ERRORERROR'
2019-01-21 06:16:06 [DEBUG   ] Got command RPT from MCS: ref #1235782
2019-01-21 06:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235782  77 58504 22566886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:16:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:16:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:16:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:16:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:16:10 [WARNING ] (13, 1, 'bot')
2019-01-21 06:16:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:16:10 [DEBUG   ] Finished updating board flags in 1.371 seconds
2019-01-21 06:16:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 06:16:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 06:16:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 06:17:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:17:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:17:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:17:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:17:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:17:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:17:11 [DEBUG   ] Finished updating board flags in 2.044 seconds
2019-01-21 06:17:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 06:17:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 06:17:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 06:18:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:18:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:18:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:18:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:18:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:18:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:18:11 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-01-21 06:18:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 06:18:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 06:18:38 [DEBUG   ] Got command RPT from MCS: ref #1235804
2019-01-21 06:18:38 [DEBUG   ] summary = ERROR
2019-01-21 06:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235804  13 58504 22718025 A  ERRORERROR'
2019-01-21 06:18:38 [DEBUG   ] Got command RPT from MCS: ref #1235805
2019-01-21 06:18:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235805  77 58504 22718229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:18:38 [DEBUG   ] Got command RPT from MCS: ref #1235806
2019-01-21 06:18:38 [DEBUG   ] summary = ERROR
2019-01-21 06:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235806  13 58504 22718421 A  ERRORERROR'
2019-01-21 06:18:38 [DEBUG   ] Got command RPT from MCS: ref #1235808
2019-01-21 06:18:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235808  77 58504 22718625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:18:38 [DEBUG   ] Got command RPT from MCS: ref #1235809
2019-01-21 06:18:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 06:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235809  12 58504 22718829 A  ERRORB–™š'
2019-01-21 06:18:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 06:19:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:19:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:19:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:19:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:19:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:19:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:19:11 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-21 06:19:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 06:19:37 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-21 06:19:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 06:20:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:20:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:20:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:20:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:20:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:20:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:20:11 [DEBUG   ] Finished updating board flags in 1.856 seconds
2019-01-21 06:20:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 06:20:37 [DEBUG   ] Finished updating ant stats in 0.588 seconds
2019-01-21 06:20:58 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-21 06:21:06 [DEBUG   ] Got command RPT from MCS: ref #1235818
2019-01-21 06:21:06 [DEBUG   ] summary = ERROR
2019-01-21 06:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235818  13 58504 22866893 A  ERRORERROR'
2019-01-21 06:21:06 [DEBUG   ] Got command RPT from MCS: ref #1235819
2019-01-21 06:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235819  77 58504 22866894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:21:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:21:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 06:21:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:21:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:21:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:21:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:21:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:21:11 [DEBUG   ] Finished updating board flags in 1.733 seconds
2019-01-21 06:21:18 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 06:21:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 06:21:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 06:22:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:22:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:22:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:22:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:22:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:22:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:22:11 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-21 06:22:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 06:22:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 06:22:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 06:23:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:23:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:23:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:23:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:23:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:23:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:23:11 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-21 06:23:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 06:23:38 [DEBUG   ] Got command RPT from MCS: ref #1235839
2019-01-21 06:23:38 [DEBUG   ] summary = ERROR
2019-01-21 06:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235839  13 58504 23018113 A  ERRORERROR'
2019-01-21 06:23:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 06:23:38 [DEBUG   ] Got command RPT from MCS: ref #1235840
2019-01-21 06:23:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235840  77 58504 23018317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:23:38 [DEBUG   ] Got command RPT from MCS: ref #1235841
2019-01-21 06:23:38 [DEBUG   ] summary = ERROR
2019-01-21 06:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235841  13 58504 23018509 A  ERRORERROR'
2019-01-21 06:23:38 [DEBUG   ] Got command RPT from MCS: ref #1235842
2019-01-21 06:23:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235842  77 58504 23018713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:23:38 [DEBUG   ] Got command RPT from MCS: ref #1235843
2019-01-21 06:23:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 06:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235843  12 58504 23018917 A  ERRORB•™š'
2019-01-21 06:23:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 06:24:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:24:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:24:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:24:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:24:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:24:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:24:11 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-21 06:24:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 06:24:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 06:24:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 06:25:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 06:25:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:25:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:25:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:25:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:25:11 [WARNING ] (13, 1, 'bot')
2019-01-21 06:25:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:25:11 [DEBUG   ] Finished updating board flags in 1.395 seconds
2019-01-21 06:25:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 06:25:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 06:25:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 06:26:06 [DEBUG   ] Got command RPT from MCS: ref #1235848
2019-01-21 06:26:06 [DEBUG   ] summary = ERROR
2019-01-21 06:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235848  13 58504 23166893 A  ERRORERROR'
2019-01-21 06:26:06 [DEBUG   ] Got command RPT from MCS: ref #1235849
2019-01-21 06:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235849  77 58504 23166894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:26:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:26:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:26:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:26:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:26:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:26:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:26:12 [DEBUG   ] Finished updating board flags in 2.210 seconds
2019-01-21 06:26:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 06:26:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 06:26:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 06:27:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:27:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 06:27:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:27:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:27:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:27:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:27:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:27:12 [DEBUG   ] Finished updating board flags in 2.215 seconds
2019-01-21 06:27:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 06:27:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 06:27:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 06:28:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:28:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:28:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:28:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:28:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:28:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:28:12 [DEBUG   ] Finished updating board flags in 2.174 seconds
2019-01-21 06:28:19 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-21 06:28:38 [DEBUG   ] Got command RPT from MCS: ref #1235867
2019-01-21 06:28:38 [DEBUG   ] summary = ERROR
2019-01-21 06:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235867  13 58504 23318197 A  ERRORERROR'
2019-01-21 06:28:38 [DEBUG   ] Got command RPT from MCS: ref #1235868
2019-01-21 06:28:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235868  77 58504 23318401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:28:38 [DEBUG   ] Got command RPT from MCS: ref #1235869
2019-01-21 06:28:38 [DEBUG   ] summary = ERROR
2019-01-21 06:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235869  13 58504 23318605 A  ERRORERROR'
2019-01-21 06:28:38 [DEBUG   ] Got command RPT from MCS: ref #1235871
2019-01-21 06:28:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235871  77 58504 23318797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:28:39 [DEBUG   ] Got command RPT from MCS: ref #1235872
2019-01-21 06:28:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 06:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235872  12 58504 23319001 A  ERRORB˜™š'
2019-01-21 06:28:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 06:28:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 06:29:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:29:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:29:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:29:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:29:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:29:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:29:12 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-01-21 06:29:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 06:29:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 06:29:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 06:30:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:30:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:30:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:30:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:30:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:30:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:30:12 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-01-21 06:30:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 06:30:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 06:30:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 06:31:06 [DEBUG   ] Got command RPT from MCS: ref #1235881
2019-01-21 06:31:06 [DEBUG   ] summary = ERROR
2019-01-21 06:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235881  13 58504 23466897 A  ERRORERROR'
2019-01-21 06:31:06 [DEBUG   ] Got command RPT from MCS: ref #1235882
2019-01-21 06:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235882  77 58504 23466898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:31:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:31:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:31:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:31:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:31:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:31:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:31:12 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-21 06:31:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 06:31:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 06:31:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 06:32:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:32:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:32:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:32:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:32:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:32:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:32:12 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-01-21 06:32:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 06:32:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 06:33:00 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 06:33:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:33:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:33:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:33:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:33:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:33:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:33:12 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-21 06:33:20 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 06:33:38 [DEBUG   ] Got command RPT from MCS: ref #1235902
2019-01-21 06:33:38 [DEBUG   ] summary = ERROR
2019-01-21 06:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235902  13 58504 23618289 A  ERRORERROR'
2019-01-21 06:33:38 [DEBUG   ] Got command RPT from MCS: ref #1235903
2019-01-21 06:33:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235903  77 58504 23618481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:33:38 [DEBUG   ] Got command RPT from MCS: ref #1235904
2019-01-21 06:33:38 [DEBUG   ] summary = ERROR
2019-01-21 06:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235904  13 58504 23618689 A  ERRORERROR'
2019-01-21 06:33:38 [DEBUG   ] Got command RPT from MCS: ref #1235905
2019-01-21 06:33:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235905  77 58504 23618881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:33:39 [DEBUG   ] Got command RPT from MCS: ref #1235906
2019-01-21 06:33:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 06:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235906  12 58504 23619085 A  ERRORB—™š'
2019-01-21 06:33:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 06:34:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 06:34:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:34:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 06:34:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:34:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:34:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:34:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:34:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:34:12 [DEBUG   ] Finished updating board flags in 1.580 seconds
2019-01-21 06:34:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 06:34:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 06:35:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 06:35:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:35:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:35:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:35:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:35:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:35:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:35:12 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-21 06:35:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 06:35:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 06:36:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 06:36:06 [DEBUG   ] Got command RPT from MCS: ref #1235911
2019-01-21 06:36:06 [DEBUG   ] summary = ERROR
2019-01-21 06:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235911  13 58504 23766889 A  ERRORERROR'
2019-01-21 06:36:06 [DEBUG   ] Got command RPT from MCS: ref #1235912
2019-01-21 06:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235912  77 58504 23766890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:36:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:36:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:36:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:36:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:36:12 [WARNING ] (13, 1, 'bot')
2019-01-21 06:36:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:36:12 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-01-21 06:36:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 06:36:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 06:37:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 06:37:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:37:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:37:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:37:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:37:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:37:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:37:13 [DEBUG   ] Finished updating board flags in 2.221 seconds
2019-01-21 06:37:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 06:37:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 06:38:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-21 06:38:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:38:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:38:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:38:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:38:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:38:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:38:13 [DEBUG   ] Finished updating board flags in 2.205 seconds
2019-01-21 06:38:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 06:38:38 [DEBUG   ] Got command RPT from MCS: ref #1235934
2019-01-21 06:38:38 [DEBUG   ] summary = ERROR
2019-01-21 06:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235934  13 58504 23918373 A  ERRORERROR'
2019-01-21 06:38:38 [DEBUG   ] Got command RPT from MCS: ref #1235935
2019-01-21 06:38:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235935  77 58504 23918565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:38:38 [DEBUG   ] Got command RPT from MCS: ref #1235936
2019-01-21 06:38:38 [DEBUG   ] summary = ERROR
2019-01-21 06:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235936  13 58504 23918769 A  ERRORERROR'
2019-01-21 06:38:38 [DEBUG   ] Got command RPT from MCS: ref #1235938
2019-01-21 06:38:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235938  77 58504 23918973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:38:39 [DEBUG   ] Got command RPT from MCS: ref #1235939
2019-01-21 06:38:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 06:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235939  12 58504 23919177 A  ERRORB•™š'
2019-01-21 06:38:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 06:39:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-01-21 06:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:39:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:39:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:39:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:39:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:39:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:39:13 [DEBUG   ] Finished updating board flags in 2.168 seconds
2019-01-21 06:39:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 06:39:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 06:40:01 [DEBUG   ] Finished updating ant stats in 1.018 seconds
2019-01-21 06:40:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 06:40:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:40:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:40:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:40:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:40:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:40:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:40:13 [DEBUG   ] Finished updating board flags in 2.037 seconds
2019-01-21 06:40:21 [DEBUG   ] Finished updating ant stats in 0.586 seconds
2019-01-21 06:40:42 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 06:41:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 06:41:06 [DEBUG   ] Got command RPT from MCS: ref #1235948
2019-01-21 06:41:06 [DEBUG   ] summary = ERROR
2019-01-21 06:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235948  13 58504 24066889 A  ERRORERROR'
2019-01-21 06:41:06 [DEBUG   ] Got command RPT from MCS: ref #1235949
2019-01-21 06:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235949  77 58504 24066890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:41:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:41:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:41:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:41:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:41:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:41:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:41:13 [DEBUG   ] Finished updating board flags in 1.960 seconds
2019-01-21 06:41:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 06:41:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 06:42:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 06:42:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:42:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 06:42:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:42:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:42:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:42:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:42:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:42:13 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-21 06:42:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 06:42:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 06:43:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 06:43:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 06:43:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:43:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:43:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:43:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:43:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:43:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:43:13 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-21 06:43:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 06:43:38 [DEBUG   ] Got command RPT from MCS: ref #1235965
2019-01-21 06:43:38 [DEBUG   ] summary = ERROR
2019-01-21 06:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235965  13 58504 24218457 A  ERRORERROR'
2019-01-21 06:43:38 [DEBUG   ] Got command RPT from MCS: ref #1235966
2019-01-21 06:43:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235966  77 58504 24218649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:43:38 [DEBUG   ] Got command RPT from MCS: ref #1235967
2019-01-21 06:43:38 [DEBUG   ] summary = ERROR
2019-01-21 06:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235967  13 58504 24218853 A  ERRORERROR'
2019-01-21 06:43:39 [DEBUG   ] Got command RPT from MCS: ref #1235968
2019-01-21 06:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235968  77 58504 24219057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:43:39 [DEBUG   ] Got command RPT from MCS: ref #1235969
2019-01-21 06:43:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 06:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235969  12 58504 24219261 A  ERRORB—™š'
2019-01-21 06:43:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 06:44:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 06:44:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 06:44:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:44:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:44:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:44:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:44:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:44:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:44:13 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-21 06:44:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 06:44:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 06:45:02 [DEBUG   ] Finished updating ant stats in 0.752 seconds
2019-01-21 06:45:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:45:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:45:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:45:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:45:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:45:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:45:13 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-21 06:45:22 [DEBUG   ] Finished updating ant stats in 0.452 seconds
2019-01-21 06:45:42 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-01-21 06:46:03 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 06:46:06 [DEBUG   ] Got command RPT from MCS: ref #1235974
2019-01-21 06:46:06 [DEBUG   ] summary = ERROR
2019-01-21 06:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235974  13 58504 24366897 A  ERRORERROR'
2019-01-21 06:46:06 [DEBUG   ] Got command RPT from MCS: ref #1235975
2019-01-21 06:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235975  77 58504 24366898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:46:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:46:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:46:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:46:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:46:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:46:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:46:13 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-21 06:46:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 06:46:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 06:47:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 06:47:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:47:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:47:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:47:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:47:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:47:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:47:13 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-21 06:47:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 06:47:43 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-21 06:48:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 06:48:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2019-01-21 06:48:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:48:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:48:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:48:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:48:13 [WARNING ] (13, 1, 'bot')
2019-01-21 06:48:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:48:13 [DEBUG   ] Finished updating board flags in 1.459 seconds
2019-01-21 06:48:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 06:48:38 [DEBUG   ] Got command RPT from MCS: ref #1235997
2019-01-21 06:48:38 [DEBUG   ] summary = ERROR
2019-01-21 06:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235997  13 58504 24518541 A  ERRORERROR'
2019-01-21 06:48:38 [DEBUG   ] Got command RPT from MCS: ref #1235998
2019-01-21 06:48:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235998  77 58504 24518745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:48:38 [DEBUG   ] Got command RPT from MCS: ref #1235999
2019-01-21 06:48:38 [DEBUG   ] summary = ERROR
2019-01-21 06:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1235999  13 58504 24518937 A  ERRORERROR'
2019-01-21 06:48:39 [DEBUG   ] Got command RPT from MCS: ref #1236001
2019-01-21 06:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236001  77 58504 24519141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:48:39 [DEBUG   ] Got command RPT from MCS: ref #1236002
2019-01-21 06:48:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 06:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236002  12 58504 24519345 A  ERRORB—™š'
2019-01-21 06:48:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 06:49:03 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-21 06:49:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:49:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:49:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:49:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:49:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:49:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:49:14 [DEBUG   ] Finished updating board flags in 2.219 seconds
2019-01-21 06:49:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 06:49:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 06:50:03 [DEBUG   ] Finished updating ant stats in 0.964 seconds
2019-01-21 06:50:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:50:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:50:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:50:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:50:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:50:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:50:14 [DEBUG   ] Finished updating board flags in 2.153 seconds
2019-01-21 06:50:23 [DEBUG   ] Finished updating ant stats in 0.444 seconds
2019-01-21 06:50:44 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-21 06:51:04 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 06:51:06 [DEBUG   ] Got command RPT from MCS: ref #1236011
2019-01-21 06:51:06 [DEBUG   ] summary = ERROR
2019-01-21 06:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236011  13 58504 24666901 A  ERRORERROR'
2019-01-21 06:51:06 [DEBUG   ] Got command RPT from MCS: ref #1236012
2019-01-21 06:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236012  77 58504 24666902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:51:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:51:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:51:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:51:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:51:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:51:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:51:14 [DEBUG   ] Finished updating board flags in 1.995 seconds
2019-01-21 06:51:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 06:51:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 06:52:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 06:52:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:52:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:52:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:52:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:52:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:52:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:52:14 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-01-21 06:52:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 06:52:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 06:53:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 06:53:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:53:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:53:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:53:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:53:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:53:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:53:14 [DEBUG   ] Finished updating board flags in 1.638 seconds
2019-01-21 06:53:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 06:53:38 [DEBUG   ] Got command RPT from MCS: ref #1236032
2019-01-21 06:53:38 [DEBUG   ] summary = ERROR
2019-01-21 06:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236032  13 58504 24818629 A  ERRORERROR'
2019-01-21 06:53:38 [DEBUG   ] Got command RPT from MCS: ref #1236033
2019-01-21 06:53:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236033  77 58504 24818833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:53:39 [DEBUG   ] Got command RPT from MCS: ref #1236034
2019-01-21 06:53:39 [DEBUG   ] summary = ERROR
2019-01-21 06:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236034  13 58504 24819025 A  ERRORERROR'
2019-01-21 06:53:39 [DEBUG   ] Got command RPT from MCS: ref #1236035
2019-01-21 06:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236035  77 58504 24819229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:53:39 [DEBUG   ] Got command RPT from MCS: ref #1236036
2019-01-21 06:53:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 06:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236036  12 58504 24819433 A  ERRORB–™š'
2019-01-21 06:53:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 06:54:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 06:54:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:54:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 06:54:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:54:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:54:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:54:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:54:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:54:14 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-21 06:54:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 06:54:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 06:55:04 [DEBUG   ] Finished updating ant stats in 1.012 seconds
2019-01-21 06:55:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:55:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:55:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:55:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:55:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:55:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:55:14 [DEBUG   ] Finished updating board flags in 1.498 seconds
2019-01-21 06:55:24 [DEBUG   ] Finished updating ant stats in 0.992 seconds
2019-01-21 06:55:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 06:56:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 06:56:06 [DEBUG   ] Got command RPT from MCS: ref #1236041
2019-01-21 06:56:06 [DEBUG   ] summary = ERROR
2019-01-21 06:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236041  13 58504 24966893 A  ERRORERROR'
2019-01-21 06:56:06 [DEBUG   ] Got command RPT from MCS: ref #1236042
2019-01-21 06:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236042  77 58504 24966894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:56:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:56:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:56:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:56:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:56:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:56:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:56:14 [DEBUG   ] Finished updating board flags in 1.445 seconds
2019-01-21 06:56:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 06:56:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 06:57:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 06:57:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:57:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:57:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:57:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:57:14 [WARNING ] (13, 1, 'bot')
2019-01-21 06:57:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:57:14 [DEBUG   ] Finished updating board flags in 1.549 seconds
2019-01-21 06:57:25 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 06:57:45 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2019-01-21 06:58:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 06:58:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 06:58:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:58:15 [WARNING ] (13, 1, 'bot')
2019-01-21 06:58:15 [WARNING ] (13, 1, 'bot')
2019-01-21 06:58:15 [WARNING ] (13, 1, 'bot')
2019-01-21 06:58:15 [WARNING ] (13, 1, 'bot')
2019-01-21 06:58:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:58:15 [DEBUG   ] Finished updating board flags in 2.186 seconds
2019-01-21 06:58:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 06:58:38 [DEBUG   ] Got command RPT from MCS: ref #1236060
2019-01-21 06:58:38 [DEBUG   ] summary = ERROR
2019-01-21 06:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236060  13 58504 25118709 A  ERRORERROR'
2019-01-21 06:58:38 [DEBUG   ] Got command RPT from MCS: ref #1236061
2019-01-21 06:58:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236061  77 58504 25118913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:58:39 [DEBUG   ] Got command RPT from MCS: ref #1236062
2019-01-21 06:58:39 [DEBUG   ] summary = ERROR
2019-01-21 06:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236062  13 58504 25119117 A  ERRORERROR'
2019-01-21 06:58:39 [DEBUG   ] Got command RPT from MCS: ref #1236064
2019-01-21 06:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 06:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236064  77 58504 25119309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 06:58:39 [DEBUG   ] Got command RPT from MCS: ref #1236065
2019-01-21 06:58:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 06:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236065  12 58504 25119513 A  ERRORB–™š'
2019-01-21 06:58:45 [DEBUG   ] Finished updating ant stats in 0.791 seconds
2019-01-21 06:59:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 06:59:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 06:59:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 06:59:15 [WARNING ] (13, 1, 'bot')
2019-01-21 06:59:15 [WARNING ] (13, 1, 'bot')
2019-01-21 06:59:15 [WARNING ] (13, 1, 'bot')
2019-01-21 06:59:15 [WARNING ] (13, 1, 'bot')
2019-01-21 06:59:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 06:59:15 [DEBUG   ] Finished updating board flags in 1.915 seconds
2019-01-21 06:59:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 06:59:46 [DEBUG   ] Finished updating ant stats in 1.388 seconds
2019-01-21 07:00:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 07:00:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:00:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:00:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:00:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:00:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:00:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:00:16 [DEBUG   ] Finished updating board flags in 2.645 seconds
2019-01-21 07:00:26 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-21 07:00:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 07:01:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 07:01:06 [DEBUG   ] Got command RPT from MCS: ref #1236074
2019-01-21 07:01:06 [DEBUG   ] summary = ERROR
2019-01-21 07:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236074  13 58504 25266901 A  ERRORERROR'
2019-01-21 07:01:06 [DEBUG   ] Got command RPT from MCS: ref #1236075
2019-01-21 07:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236075  77 58504 25266902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:01:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 07:01:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:01:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:01:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:01:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:01:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:01:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:01:15 [DEBUG   ] Finished updating board flags in 1.743 seconds
2019-01-21 07:01:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 07:01:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 07:02:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 07:02:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:02:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:02:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:02:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:02:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:02:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:02:15 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-21 07:02:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 07:02:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 07:03:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 07:03:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:03:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:03:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:03:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:03:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:03:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:03:15 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-21 07:03:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 07:03:38 [DEBUG   ] Got command RPT from MCS: ref #1236095
2019-01-21 07:03:38 [DEBUG   ] summary = ERROR
2019-01-21 07:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236095  13 58504 25418801 A  ERRORERROR'
2019-01-21 07:03:38 [DEBUG   ] Got command RPT from MCS: ref #1236096
2019-01-21 07:03:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236096  77 58504 25418993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:03:39 [DEBUG   ] Got command RPT from MCS: ref #1236097
2019-01-21 07:03:39 [DEBUG   ] summary = ERROR
2019-01-21 07:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236097  13 58504 25419197 A  ERRORERROR'
2019-01-21 07:03:39 [DEBUG   ] Got command RPT from MCS: ref #1236098
2019-01-21 07:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236098  77 58504 25419401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:03:39 [DEBUG   ] Got command RPT from MCS: ref #1236099
2019-01-21 07:03:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 07:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236099  12 58504 25419605 A  ERRORB—™š'
2019-01-21 07:03:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 07:04:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 07:04:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-21 07:04:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:04:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:04:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:04:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:04:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:04:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:04:15 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-21 07:04:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 07:04:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 07:05:07 [DEBUG   ] Finished updating ant stats in 1.415 seconds
2019-01-21 07:05:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:05:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:05:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:05:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:05:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:05:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:05:15 [DEBUG   ] Finished updating board flags in 1.567 seconds
2019-01-21 07:05:27 [DEBUG   ] Finished updating ant stats in 1.387 seconds
2019-01-21 07:05:47 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 07:06:06 [DEBUG   ] Got command RPT from MCS: ref #1236104
2019-01-21 07:06:06 [DEBUG   ] summary = ERROR
2019-01-21 07:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236104  13 58504 25566905 A  ERRORERROR'
2019-01-21 07:06:06 [DEBUG   ] Got command RPT from MCS: ref #1236105
2019-01-21 07:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236105  77 58504 25566906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:06:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 07:06:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:06:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 07:06:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:06:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:06:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:06:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:06:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:06:15 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-21 07:06:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 07:06:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 07:07:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 07:07:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:07:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 07:07:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:07:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:07:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:07:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:07:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:07:15 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-01-21 07:07:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 07:07:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 07:08:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 07:08:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:08:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:08:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:08:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:08:15 [WARNING ] (13, 1, 'bot')
2019-01-21 07:08:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:08:15 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-01-21 07:08:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 07:08:38 [DEBUG   ] Got command RPT from MCS: ref #1236127
2019-01-21 07:08:38 [DEBUG   ] summary = ERROR
2019-01-21 07:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236127  13 58504 25718881 A  ERRORERROR'
2019-01-21 07:08:39 [DEBUG   ] Got command RPT from MCS: ref #1236128
2019-01-21 07:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236128  77 58504 25719085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:08:39 [DEBUG   ] Got command RPT from MCS: ref #1236129
2019-01-21 07:08:39 [DEBUG   ] summary = ERROR
2019-01-21 07:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236129  13 58504 25719277 A  ERRORERROR'
2019-01-21 07:08:39 [DEBUG   ] Got command RPT from MCS: ref #1236131
2019-01-21 07:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236131  77 58504 25719481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:08:39 [DEBUG   ] Got command RPT from MCS: ref #1236132
2019-01-21 07:08:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 07:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236132  12 58504 25719690 A  ERRORB–™š'
2019-01-21 07:08:47 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-21 07:09:08 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-21 07:09:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:09:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 07:09:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:09:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:09:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:09:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:09:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:09:16 [DEBUG   ] Finished updating board flags in 2.067 seconds
2019-01-21 07:09:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 07:09:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 07:10:08 [DEBUG   ] Finished updating ant stats in 1.215 seconds
2019-01-21 07:10:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:10:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:10:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:10:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:10:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:10:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:10:16 [DEBUG   ] Finished updating board flags in 1.996 seconds
2019-01-21 07:10:28 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2019-01-21 07:10:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 07:11:06 [DEBUG   ] Got command RPT from MCS: ref #1236141
2019-01-21 07:11:06 [DEBUG   ] summary = ERROR
2019-01-21 07:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236141  13 58504 25866901 A  ERRORERROR'
2019-01-21 07:11:06 [DEBUG   ] Got command RPT from MCS: ref #1236142
2019-01-21 07:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236142  77 58504 25866902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:11:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 07:11:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:11:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:11:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:11:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:11:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:11:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:11:16 [DEBUG   ] Finished updating board flags in 1.803 seconds
2019-01-21 07:11:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 07:11:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 07:12:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 07:12:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:12:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:12:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:12:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:12:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:12:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:12:16 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-01-21 07:12:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 07:12:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 07:13:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 07:13:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:13:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:13:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:13:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:13:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:13:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:13:16 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-21 07:13:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 07:13:38 [DEBUG   ] Got command RPT from MCS: ref #1236158
2019-01-21 07:13:38 [DEBUG   ] summary = ERROR
2019-01-21 07:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236158  13 58504 26018965 A  ERRORERROR'
2019-01-21 07:13:39 [DEBUG   ] Got command RPT from MCS: ref #1236159
2019-01-21 07:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236159  77 58504 26019169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:13:39 [DEBUG   ] Got command RPT from MCS: ref #1236160
2019-01-21 07:13:39 [DEBUG   ] summary = ERROR
2019-01-21 07:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236160  13 58504 26019373 A  ERRORERROR'
2019-01-21 07:13:39 [DEBUG   ] Got command RPT from MCS: ref #1236161
2019-01-21 07:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236161  77 58504 26019565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:13:39 [DEBUG   ] Got command RPT from MCS: ref #1236162
2019-01-21 07:13:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 07:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236162  12 58504 26019769 A  ERRORB•™š'
2019-01-21 07:13:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-21 07:14:09 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-21 07:14:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:14:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:14:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:14:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:14:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:14:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:14:16 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-21 07:14:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 07:14:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 07:15:09 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2019-01-21 07:15:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:15:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:15:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:15:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:15:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:15:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:15:16 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-21 07:15:29 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2019-01-21 07:15:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 07:16:06 [DEBUG   ] Got command RPT from MCS: ref #1236167
2019-01-21 07:16:06 [DEBUG   ] summary = ERROR
2019-01-21 07:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236167  13 58504 26166897 A  ERRORERROR'
2019-01-21 07:16:06 [DEBUG   ] Got command RPT from MCS: ref #1236168
2019-01-21 07:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236168  77 58504 26166898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:16:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 07:16:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:16:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 07:16:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:16:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:16:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:16:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:16:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:16:16 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-01-21 07:16:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 07:16:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 07:17:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 07:17:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 07:17:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:17:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:17:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:17:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:17:16 [WARNING ] (13, 1, 'bot')
2019-01-21 07:17:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:17:16 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-01-21 07:17:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 07:17:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 07:18:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 07:18:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:18:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:18:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:18:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:18:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:18:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:18:17 [DEBUG   ] Finished updating board flags in 2.038 seconds
2019-01-21 07:18:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 07:18:39 [DEBUG   ] Got command RPT from MCS: ref #1236190
2019-01-21 07:18:39 [DEBUG   ] summary = ERROR
2019-01-21 07:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236190  13 58504 26319049 A  ERRORERROR'
2019-01-21 07:18:39 [DEBUG   ] Got command RPT from MCS: ref #1236191
2019-01-21 07:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236191  77 58504 26319257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:18:39 [DEBUG   ] Got command RPT from MCS: ref #1236192
2019-01-21 07:18:39 [DEBUG   ] summary = ERROR
2019-01-21 07:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236192  13 58504 26319449 A  ERRORERROR'
2019-01-21 07:18:39 [DEBUG   ] Got command RPT from MCS: ref #1236194
2019-01-21 07:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236194  77 58504 26319653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:18:39 [DEBUG   ] Got command RPT from MCS: ref #1236195
2019-01-21 07:18:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 07:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236195  12 58504 26319857 A  ERRORB—™š'
2019-01-21 07:18:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 07:19:09 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-21 07:19:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 07:19:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:19:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:19:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:19:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:19:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:19:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:19:17 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-21 07:19:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 07:19:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 07:20:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 07:20:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:20:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:20:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:20:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:20:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:20:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:20:17 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-21 07:20:30 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2019-01-21 07:20:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 07:21:06 [DEBUG   ] Got command RPT from MCS: ref #1236204
2019-01-21 07:21:06 [DEBUG   ] summary = ERROR
2019-01-21 07:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236204  13 58504 26466901 A  ERRORERROR'
2019-01-21 07:21:06 [DEBUG   ] Got command RPT from MCS: ref #1236205
2019-01-21 07:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236205  77 58504 26466902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:21:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 07:21:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:21:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:21:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:21:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:21:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:21:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:21:17 [DEBUG   ] Finished updating board flags in 1.797 seconds
2019-01-21 07:21:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 07:21:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 07:22:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 07:22:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:22:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:22:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:22:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:22:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:22:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:22:17 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-21 07:22:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 07:22:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 07:23:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 07:23:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:23:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:23:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:23:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:23:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:23:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:23:17 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-21 07:23:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 07:23:39 [DEBUG   ] Got command RPT from MCS: ref #1236225
2019-01-21 07:23:39 [DEBUG   ] summary = ERROR
2019-01-21 07:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236225  13 58504 26619141 A  ERRORERROR'
2019-01-21 07:23:39 [DEBUG   ] Got command RPT from MCS: ref #1236226
2019-01-21 07:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236226  77 58504 26619345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:23:39 [DEBUG   ] Got command RPT from MCS: ref #1236227
2019-01-21 07:23:39 [DEBUG   ] summary = ERROR
2019-01-21 07:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236227  13 58504 26619537 A  ERRORERROR'
2019-01-21 07:23:39 [DEBUG   ] Got command RPT from MCS: ref #1236228
2019-01-21 07:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236228  77 58504 26619741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:23:39 [DEBUG   ] Got command RPT from MCS: ref #1236229
2019-01-21 07:23:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 07:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236229  12 58504 26619953 A  ERRORB–™š'
2019-01-21 07:23:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 07:24:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 07:24:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:24:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:24:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:24:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:24:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:24:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:24:17 [DEBUG   ] Finished updating board flags in 1.404 seconds
2019-01-21 07:24:31 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 07:24:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 07:25:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 07:25:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:25:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:25:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:25:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:25:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:25:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:25:17 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-01-21 07:25:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 07:25:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 07:26:06 [DEBUG   ] Got command RPT from MCS: ref #1236234
2019-01-21 07:26:06 [DEBUG   ] summary = ERROR
2019-01-21 07:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236234  13 58504 26766905 A  ERRORERROR'
2019-01-21 07:26:06 [DEBUG   ] Got command RPT from MCS: ref #1236235
2019-01-21 07:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236235  77 58504 26766906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:26:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 07:26:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:26:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:26:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:26:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:26:17 [WARNING ] (13, 1, 'bot')
2019-01-21 07:26:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:26:17 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-01-21 07:26:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 07:26:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 07:27:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 07:27:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:27:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:27:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:27:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:27:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:27:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:27:18 [DEBUG   ] Finished updating board flags in 2.060 seconds
2019-01-21 07:27:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 07:27:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 07:28:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 07:28:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:28:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 07:28:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:28:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:28:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:28:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:28:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:28:18 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-01-21 07:28:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 07:28:39 [DEBUG   ] Got command RPT from MCS: ref #1236258
2019-01-21 07:28:39 [DEBUG   ] summary = ERROR
2019-01-21 07:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236258  13 58504 26919229 A  ERRORERROR'
2019-01-21 07:28:39 [DEBUG   ] Got command RPT from MCS: ref #1236259
2019-01-21 07:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236259  77 58504 26919421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:28:39 [DEBUG   ] Got command RPT from MCS: ref #1236260
2019-01-21 07:28:39 [DEBUG   ] summary = ERROR
2019-01-21 07:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236260  13 58504 26919625 A  ERRORERROR'
2019-01-21 07:28:39 [DEBUG   ] Got command RPT from MCS: ref #1236262
2019-01-21 07:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236262  77 58504 26919829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:28:40 [DEBUG   ] Got command RPT from MCS: ref #1236264
2019-01-21 07:28:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 07:28:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236264  12 58504 26920021 A  ERRORB–™š'
2019-01-21 07:28:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 07:29:12 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 07:29:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:29:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:29:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:29:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:29:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:29:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:29:18 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-01-21 07:29:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 07:29:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 07:30:12 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2019-01-21 07:30:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 07:30:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:30:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:30:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:30:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:30:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:30:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:30:18 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-21 07:30:32 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2019-01-21 07:30:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 07:31:06 [DEBUG   ] Got command RPT from MCS: ref #1236277
2019-01-21 07:31:06 [DEBUG   ] summary = ERROR
2019-01-21 07:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236277  13 58504 27066901 A  ERRORERROR'
2019-01-21 07:31:06 [DEBUG   ] Got command RPT from MCS: ref #1236278
2019-01-21 07:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236278  77 58504 27066902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:31:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 07:31:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:31:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:31:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:31:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:31:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:31:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:31:18 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-21 07:31:33 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 07:31:53 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 07:32:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 07:32:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:32:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:32:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:32:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:32:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:32:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:32:18 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-21 07:32:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 07:32:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 07:33:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 07:33:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 07:33:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:33:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:33:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:33:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:33:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:33:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:33:18 [DEBUG   ] Finished updating board flags in 1.676 seconds
2019-01-21 07:33:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 07:33:39 [DEBUG   ] Got command RPT from MCS: ref #1236298
2019-01-21 07:33:39 [DEBUG   ] summary = ERROR
2019-01-21 07:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236298  13 58504 27219305 A  ERRORERROR'
2019-01-21 07:33:39 [DEBUG   ] Got command RPT from MCS: ref #1236299
2019-01-21 07:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236299  77 58504 27219509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:33:39 [DEBUG   ] Got command RPT from MCS: ref #1236300
2019-01-21 07:33:39 [DEBUG   ] summary = ERROR
2019-01-21 07:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236300  13 58504 27219713 A  ERRORERROR'
2019-01-21 07:33:39 [DEBUG   ] Got command RPT from MCS: ref #1236301
2019-01-21 07:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236301  77 58504 27219917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:33:40 [DEBUG   ] Got command RPT from MCS: ref #1236302
2019-01-21 07:33:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 07:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236302  12 58504 27220109 A  ERRORB˜™š'
2019-01-21 07:33:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 07:34:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 07:34:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:34:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:34:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:34:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:34:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:34:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:34:18 [DEBUG   ] Finished updating board flags in 1.513 seconds
2019-01-21 07:34:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 07:34:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 07:35:13 [DEBUG   ] Finished updating ant stats in 0.807 seconds
2019-01-21 07:35:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:35:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 07:35:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:35:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:35:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:35:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:35:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:35:18 [DEBUG   ] Finished updating board flags in 1.524 seconds
2019-01-21 07:35:33 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 07:35:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 07:36:06 [DEBUG   ] Got command RPT from MCS: ref #1236307
2019-01-21 07:36:06 [DEBUG   ] summary = ERROR
2019-01-21 07:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236307  13 58504 27366909 A  ERRORERROR'
2019-01-21 07:36:06 [DEBUG   ] Got command RPT from MCS: ref #1236308
2019-01-21 07:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236308  77 58504 27366910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:36:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 07:36:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:36:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 07:36:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:36:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:36:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:36:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:36:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:36:18 [DEBUG   ] Finished updating board flags in 1.429 seconds
2019-01-21 07:36:34 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 07:36:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 07:37:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 07:37:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:37:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:37:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:37:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:37:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:37:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:37:18 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-01-21 07:37:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 07:37:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 07:38:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 07:38:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:38:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:38:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:38:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:38:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:38:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:38:18 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-01-21 07:38:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 07:38:39 [DEBUG   ] Got command RPT from MCS: ref #1236330
2019-01-21 07:38:39 [DEBUG   ] summary = ERROR
2019-01-21 07:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236330  13 58504 27519393 A  ERRORERROR'
2019-01-21 07:38:39 [DEBUG   ] Got command RPT from MCS: ref #1236331
2019-01-21 07:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236331  77 58504 27519614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:38:39 [DEBUG   ] Got command RPT from MCS: ref #1236332
2019-01-21 07:38:39 [DEBUG   ] summary = ERROR
2019-01-21 07:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236332  13 58504 27519793 A  ERRORERROR'
2019-01-21 07:38:39 [DEBUG   ] Got command RPT from MCS: ref #1236334
2019-01-21 07:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236334  77 58504 27519997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:38:40 [DEBUG   ] Got command RPT from MCS: ref #1236335
2019-01-21 07:38:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 07:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236335  12 58504 27520201 A  ERRORB—™š'
2019-01-21 07:38:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 07:39:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 07:39:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:39:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:39:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:39:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:39:18 [WARNING ] (13, 1, 'bot')
2019-01-21 07:39:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:39:18 [DEBUG   ] Finished updating board flags in 1.440 seconds
2019-01-21 07:39:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 07:39:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 07:40:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 07:40:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:40:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:40:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:40:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:40:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:40:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:40:19 [DEBUG   ] Finished updating board flags in 2.194 seconds
2019-01-21 07:40:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 07:40:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 07:41:06 [DEBUG   ] Got command RPT from MCS: ref #1236344
2019-01-21 07:41:06 [DEBUG   ] summary = ERROR
2019-01-21 07:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236344  13 58504 27666905 A  ERRORERROR'
2019-01-21 07:41:06 [DEBUG   ] Got command RPT from MCS: ref #1236345
2019-01-21 07:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236345  77 58504 27666906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:41:14 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-21 07:41:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:41:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:41:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:41:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:41:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:41:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:41:19 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-01-21 07:41:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 07:41:55 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 07:42:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 07:42:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:42:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:42:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:42:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:42:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:42:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:42:19 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-21 07:42:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 07:42:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 07:43:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 07:43:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 07:43:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:43:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:43:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:43:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:43:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:43:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:43:19 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-21 07:43:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 07:43:39 [DEBUG   ] Got command RPT from MCS: ref #1236361
2019-01-21 07:43:39 [DEBUG   ] summary = ERROR
2019-01-21 07:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236361  13 58504 27819485 A  ERRORERROR'
2019-01-21 07:43:39 [DEBUG   ] Got command RPT from MCS: ref #1236362
2019-01-21 07:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236362  77 58504 27819677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:43:39 [DEBUG   ] Got command RPT from MCS: ref #1236363
2019-01-21 07:43:39 [DEBUG   ] summary = ERROR
2019-01-21 07:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236363  13 58504 27819881 A  ERRORERROR'
2019-01-21 07:43:40 [DEBUG   ] Got command RPT from MCS: ref #1236364
2019-01-21 07:43:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236364  77 58504 27820085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:43:40 [DEBUG   ] Got command RPT from MCS: ref #1236365
2019-01-21 07:43:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 07:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236365  12 58504 27820289 A  ERRORB—™š'
2019-01-21 07:43:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 07:44:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 07:44:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:44:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:44:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:44:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:44:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:44:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:44:19 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-21 07:44:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 07:44:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 07:45:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 07:45:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:45:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:45:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:45:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:45:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:45:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:45:19 [DEBUG   ] Finished updating board flags in 1.770 seconds
2019-01-21 07:45:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 07:45:55 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-21 07:46:06 [DEBUG   ] Got command RPT from MCS: ref #1236370
2019-01-21 07:46:06 [DEBUG   ] summary = ERROR
2019-01-21 07:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236370  13 58504 27966913 A  ERRORERROR'
2019-01-21 07:46:06 [DEBUG   ] Got command RPT from MCS: ref #1236371
2019-01-21 07:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236371  77 58504 27966914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:46:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 07:46:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:46:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:46:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:46:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:46:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:46:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:46:19 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-21 07:46:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 07:46:55 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-01-21 07:47:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 07:47:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:47:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:47:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:47:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:47:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:47:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:47:19 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-21 07:47:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 07:47:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 07:48:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 07:48:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 07:48:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:48:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:48:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:48:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:48:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:48:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:48:19 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-21 07:48:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 07:48:39 [DEBUG   ] Got command RPT from MCS: ref #1236393
2019-01-21 07:48:39 [DEBUG   ] summary = ERROR
2019-01-21 07:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236393  13 58504 28119561 A  ERRORERROR'
2019-01-21 07:48:39 [DEBUG   ] Got command RPT from MCS: ref #1236394
2019-01-21 07:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236394  77 58504 28119765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:48:39 [DEBUG   ] Got command RPT from MCS: ref #1236395
2019-01-21 07:48:39 [DEBUG   ] summary = ERROR
2019-01-21 07:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236395  13 58504 28119969 A  ERRORERROR'
2019-01-21 07:48:40 [DEBUG   ] Got command RPT from MCS: ref #1236397
2019-01-21 07:48:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236397  77 58504 28120173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:48:40 [DEBUG   ] Got command RPT from MCS: ref #1236398
2019-01-21 07:48:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 07:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236398  12 58504 28120365 A  ERRORB˜™š'
2019-01-21 07:48:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 07:49:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 07:49:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:49:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:49:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:49:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:49:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:49:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:49:19 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-21 07:49:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 07:49:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 07:50:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 07:50:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:50:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:50:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:50:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:50:19 [WARNING ] (13, 1, 'bot')
2019-01-21 07:50:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:50:19 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-01-21 07:50:36 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-21 07:50:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 07:51:06 [DEBUG   ] Got command RPT from MCS: ref #1236407
2019-01-21 07:51:06 [DEBUG   ] summary = ERROR
2019-01-21 07:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236407  13 58504 28266909 A  ERRORERROR'
2019-01-21 07:51:06 [DEBUG   ] Got command RPT from MCS: ref #1236408
2019-01-21 07:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236408  77 58504 28266910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:51:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 07:51:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:51:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:51:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:51:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:51:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:51:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:51:20 [DEBUG   ] Finished updating board flags in 2.054 seconds
2019-01-21 07:51:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 07:51:57 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 07:52:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 07:52:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:52:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:52:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:52:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:52:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:52:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:52:20 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-01-21 07:52:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 07:52:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 07:53:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 07:53:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:53:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:53:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:53:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:53:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:53:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:53:20 [DEBUG   ] Finished updating board flags in 1.868 seconds
2019-01-21 07:53:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 07:53:39 [DEBUG   ] Got command RPT from MCS: ref #1236428
2019-01-21 07:53:39 [DEBUG   ] summary = ERROR
2019-01-21 07:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236428  13 58504 28419649 A  ERRORERROR'
2019-01-21 07:53:39 [DEBUG   ] Got command RPT from MCS: ref #1236429
2019-01-21 07:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236429  77 58504 28419853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:53:40 [DEBUG   ] Got command RPT from MCS: ref #1236430
2019-01-21 07:53:40 [DEBUG   ] summary = ERROR
2019-01-21 07:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236430  13 58504 28420057 A  ERRORERROR'
2019-01-21 07:53:40 [DEBUG   ] Got command RPT from MCS: ref #1236431
2019-01-21 07:53:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236431  77 58504 28420261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:53:40 [DEBUG   ] Got command RPT from MCS: ref #1236432
2019-01-21 07:53:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 07:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236432  12 58504 28420453 A  ERRORB–™š'
2019-01-21 07:53:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 07:54:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 07:54:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:54:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 07:54:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:54:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:54:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:54:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:54:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:54:20 [DEBUG   ] Finished updating board flags in 1.776 seconds
2019-01-21 07:54:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 07:54:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 07:55:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 07:55:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:55:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:55:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:55:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:55:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:55:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:55:20 [DEBUG   ] Finished updating board flags in 1.628 seconds
2019-01-21 07:55:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 07:55:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 07:56:06 [DEBUG   ] Got command RPT from MCS: ref #1236437
2019-01-21 07:56:06 [DEBUG   ] summary = ERROR
2019-01-21 07:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236437  13 58504 28566918 A  ERRORERROR'
2019-01-21 07:56:06 [DEBUG   ] Got command RPT from MCS: ref #1236438
2019-01-21 07:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236438  77 58504 28566918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:56:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 07:56:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:56:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:56:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:56:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:56:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:56:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:56:20 [DEBUG   ] Finished updating board flags in 1.551 seconds
2019-01-21 07:56:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 07:56:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 07:57:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 07:57:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:57:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:57:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:57:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:57:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:57:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:57:20 [DEBUG   ] Finished updating board flags in 1.484 seconds
2019-01-21 07:57:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 07:57:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 07:58:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 07:58:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:58:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 07:58:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:58:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:58:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:58:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:58:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:58:20 [DEBUG   ] Finished updating board flags in 1.511 seconds
2019-01-21 07:58:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 07:58:39 [DEBUG   ] Got command RPT from MCS: ref #1236456
2019-01-21 07:58:39 [DEBUG   ] summary = ERROR
2019-01-21 07:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236456  13 58504 28719733 A  ERRORERROR'
2019-01-21 07:58:39 [DEBUG   ] Got command RPT from MCS: ref #1236457
2019-01-21 07:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236457  77 58504 28719937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:58:40 [DEBUG   ] Got command RPT from MCS: ref #1236458
2019-01-21 07:58:40 [DEBUG   ] summary = ERROR
2019-01-21 07:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236458  13 58504 28720141 A  ERRORERROR'
2019-01-21 07:58:40 [DEBUG   ] Got command RPT from MCS: ref #1236460
2019-01-21 07:58:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 07:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236460  77 58504 28720345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 07:58:40 [DEBUG   ] Got command RPT from MCS: ref #1236462
2019-01-21 07:58:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 07:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236462  12 58504 28720537 A  ERRORB•™š'
2019-01-21 07:58:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 07:59:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 07:59:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 07:59:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-21 07:59:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:59:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:59:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:59:20 [WARNING ] (13, 1, 'bot')
2019-01-21 07:59:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 07:59:20 [DEBUG   ] Finished updating board flags in 1.506 seconds
2019-01-21 07:59:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 07:59:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 08:00:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 08:00:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 08:00:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:00:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 08:00:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:00:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:00:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:00:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:00:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:00:21 [DEBUG   ] Finished updating board flags in 2.137 seconds
2019-01-21 08:00:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 08:00:58 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 08:01:06 [DEBUG   ] Got command RPT from MCS: ref #1236470
2019-01-21 08:01:06 [DEBUG   ] summary = ERROR
2019-01-21 08:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236470  13 58504 28866929 A  ERRORERROR'
2019-01-21 08:01:06 [DEBUG   ] Got command RPT from MCS: ref #1236471
2019-01-21 08:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236471  77 58504 28866929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:01:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 08:01:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:01:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:01:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:01:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:01:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:01:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:01:21 [DEBUG   ] Finished updating board flags in 1.960 seconds
2019-01-21 08:01:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 08:01:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 08:02:18 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-21 08:02:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:02:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:02:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:02:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:02:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:02:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:02:21 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-21 08:02:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 08:02:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 08:03:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 08:03:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:03:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:03:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:03:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:03:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:03:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:03:21 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-01-21 08:03:38 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-21 08:03:39 [DEBUG   ] Got command RPT from MCS: ref #1236491
2019-01-21 08:03:39 [DEBUG   ] summary = ERROR
2019-01-21 08:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236491  13 58504 29019829 A  ERRORERROR'
2019-01-21 08:03:40 [DEBUG   ] Got command RPT from MCS: ref #1236492
2019-01-21 08:03:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236492  77 58504 29020021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:03:40 [DEBUG   ] Got command RPT from MCS: ref #1236493
2019-01-21 08:03:40 [DEBUG   ] summary = ERROR
2019-01-21 08:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236493  13 58504 29020225 A  ERRORERROR'
2019-01-21 08:03:40 [DEBUG   ] Got command RPT from MCS: ref #1236494
2019-01-21 08:03:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236494  77 58504 29020429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:03:40 [DEBUG   ] Got command RPT from MCS: ref #1236495
2019-01-21 08:03:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 08:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236495  12 58504 29020621 A  ERRORB—™š'
2019-01-21 08:03:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 08:04:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 08:04:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:04:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:04:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:04:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:04:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:04:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:04:21 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-21 08:04:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 08:04:58 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-21 08:05:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 08:05:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:05:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:05:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:05:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:05:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:05:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:05:21 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-01-21 08:05:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 08:05:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 08:06:06 [DEBUG   ] Got command RPT from MCS: ref #1236500
2019-01-21 08:06:06 [DEBUG   ] summary = ERROR
2019-01-21 08:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236500  13 58504 29166913 A  ERRORERROR'
2019-01-21 08:06:06 [DEBUG   ] Got command RPT from MCS: ref #1236501
2019-01-21 08:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236501  77 58504 29166914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:06:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 08:06:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:06:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:06:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:06:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:06:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:06:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:06:21 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-21 08:06:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 08:06:59 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 08:07:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 08:07:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:07:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:07:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:07:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:07:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:07:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:07:21 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-01-21 08:07:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 08:07:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 08:08:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 08:08:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:08:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:08:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:08:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:08:21 [WARNING ] (13, 1, 'bot')
2019-01-21 08:08:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:08:21 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-21 08:08:39 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-21 08:08:39 [DEBUG   ] Got command RPT from MCS: ref #1236523
2019-01-21 08:08:39 [DEBUG   ] summary = ERROR
2019-01-21 08:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236523  13 58504 29319909 A  ERRORERROR'
2019-01-21 08:08:40 [DEBUG   ] Got command RPT from MCS: ref #1236524
2019-01-21 08:08:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236524  77 58504 29320113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:08:40 [DEBUG   ] Got command RPT from MCS: ref #1236525
2019-01-21 08:08:40 [DEBUG   ] summary = ERROR
2019-01-21 08:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236525  13 58504 29320305 A  ERRORERROR'
2019-01-21 08:08:40 [DEBUG   ] Got command RPT from MCS: ref #1236527
2019-01-21 08:08:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236527  77 58504 29320509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:08:40 [DEBUG   ] Got command RPT from MCS: ref #1236528
2019-01-21 08:08:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 08:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236528  12 58504 29320713 A  ERRORB—™š'
2019-01-21 08:08:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 08:09:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 08:09:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:09:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 08:09:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:09:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:09:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:09:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:09:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:09:22 [DEBUG   ] Finished updating board flags in 2.257 seconds
2019-01-21 08:09:39 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2019-01-21 08:09:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 08:10:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 08:10:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:10:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:10:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:10:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:10:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:10:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:10:22 [DEBUG   ] Finished updating board flags in 2.156 seconds
2019-01-21 08:10:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 08:10:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 08:11:06 [DEBUG   ] Got command RPT from MCS: ref #1236537
2019-01-21 08:11:06 [DEBUG   ] summary = ERROR
2019-01-21 08:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236537  13 58504 29466913 A  ERRORERROR'
2019-01-21 08:11:06 [DEBUG   ] Got command RPT from MCS: ref #1236538
2019-01-21 08:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236538  77 58504 29466914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:11:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 08:11:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:11:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:11:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:11:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:11:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:11:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:11:22 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-01-21 08:11:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 08:11:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 08:12:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 08:12:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:12:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:12:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:12:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:12:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:12:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:12:22 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-21 08:12:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 08:12:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 08:13:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 08:13:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:13:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:13:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:13:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:13:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:13:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:13:22 [DEBUG   ] Finished updating board flags in 1.771 seconds
2019-01-21 08:13:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 08:13:39 [DEBUG   ] Got command RPT from MCS: ref #1236554
2019-01-21 08:13:39 [DEBUG   ] summary = ERROR
2019-01-21 08:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236554  13 58504 29619993 A  ERRORERROR'
2019-01-21 08:13:40 [DEBUG   ] Got command RPT from MCS: ref #1236555
2019-01-21 08:13:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236555  77 58504 29620197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:13:40 [DEBUG   ] Got command RPT from MCS: ref #1236556
2019-01-21 08:13:40 [DEBUG   ] summary = ERROR
2019-01-21 08:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236556  13 58504 29620401 A  ERRORERROR'
2019-01-21 08:13:40 [DEBUG   ] Got command RPT from MCS: ref #1236557
2019-01-21 08:13:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236557  77 58504 29620593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:13:40 [DEBUG   ] Got command RPT from MCS: ref #1236558
2019-01-21 08:13:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 08:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236558  12 58504 29620797 A  ERRORB•™š'
2019-01-21 08:13:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 08:14:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 08:14:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:14:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:14:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:14:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:14:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:14:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:14:22 [DEBUG   ] Finished updating board flags in 1.654 seconds
2019-01-21 08:14:39 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-21 08:14:59 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 08:15:20 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-21 08:15:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:15:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:15:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:15:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:15:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:15:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:15:22 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-21 08:15:40 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 08:16:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 08:16:06 [DEBUG   ] Got command RPT from MCS: ref #1236563
2019-01-21 08:16:06 [DEBUG   ] summary = ERROR
2019-01-21 08:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236563  13 58504 29766921 A  ERRORERROR'
2019-01-21 08:16:06 [DEBUG   ] Got command RPT from MCS: ref #1236564
2019-01-21 08:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236564  77 58504 29766922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:16:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 08:16:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:16:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:16:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:16:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:16:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:16:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:16:22 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-21 08:16:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 08:17:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 08:17:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 08:17:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:17:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:17:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:17:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:17:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:17:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:17:22 [DEBUG   ] Finished updating board flags in 1.515 seconds
2019-01-21 08:17:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 08:18:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 08:18:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 08:18:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:18:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:18:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:18:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:18:22 [WARNING ] (13, 1, 'bot')
2019-01-21 08:18:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:18:22 [DEBUG   ] Finished updating board flags in 1.538 seconds
2019-01-21 08:18:40 [DEBUG   ] Got command RPT from MCS: ref #1236586
2019-01-21 08:18:40 [DEBUG   ] summary = ERROR
2019-01-21 08:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236586  13 58504 29920077 A  ERRORERROR'
2019-01-21 08:18:40 [DEBUG   ] Got command RPT from MCS: ref #1236587
2019-01-21 08:18:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236587  77 58504 29920281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:18:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 08:18:40 [DEBUG   ] Got command RPT from MCS: ref #1236588
2019-01-21 08:18:40 [DEBUG   ] summary = ERROR
2019-01-21 08:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236588  13 58504 29920485 A  ERRORERROR'
2019-01-21 08:18:40 [DEBUG   ] Got command RPT from MCS: ref #1236590
2019-01-21 08:18:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236590  77 58504 29920689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:18:40 [DEBUG   ] Got command RPT from MCS: ref #1236592
2019-01-21 08:18:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 08:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236592  12 58504 29920881 A  ERRORB–™š'
2019-01-21 08:19:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 08:19:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 08:19:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:19:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 08:19:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:19:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:19:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:19:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:19:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:19:23 [DEBUG   ] Finished updating board flags in 2.228 seconds
2019-01-21 08:19:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 08:20:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 08:20:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 08:20:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:20:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:20:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:20:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:20:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:20:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:20:23 [DEBUG   ] Finished updating board flags in 2.072 seconds
2019-01-21 08:20:40 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 08:21:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 08:21:06 [DEBUG   ] Got command RPT from MCS: ref #1236600
2019-01-21 08:21:06 [DEBUG   ] summary = ERROR
2019-01-21 08:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236600  13 58504 30066913 A  ERRORERROR'
2019-01-21 08:21:06 [DEBUG   ] Got command RPT from MCS: ref #1236601
2019-01-21 08:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236601  77 58504 30066914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:21:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 08:21:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:21:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:21:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:21:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:21:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:21:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:21:23 [DEBUG   ] Finished updating board flags in 2.011 seconds
2019-01-21 08:21:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 08:22:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 08:22:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 08:22:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:22:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:22:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:22:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:22:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:22:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:22:23 [DEBUG   ] Finished updating board flags in 2.030 seconds
2019-01-21 08:22:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 08:23:00 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 08:23:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 08:23:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:23:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:23:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:23:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:23:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:23:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:23:23 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-01-21 08:23:40 [DEBUG   ] Got command RPT from MCS: ref #1236621
2019-01-21 08:23:40 [DEBUG   ] summary = ERROR
2019-01-21 08:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236621  13 58504 30220165 A  ERRORERROR'
2019-01-21 08:23:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 08:23:40 [DEBUG   ] Got command RPT from MCS: ref #1236622
2019-01-21 08:23:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236622  77 58504 30220373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:23:40 [DEBUG   ] Got command RPT from MCS: ref #1236623
2019-01-21 08:23:40 [DEBUG   ] summary = ERROR
2019-01-21 08:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236623  13 58504 30220577 A  ERRORERROR'
2019-01-21 08:23:40 [DEBUG   ] Got command RPT from MCS: ref #1236624
2019-01-21 08:23:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236624  77 58504 30220769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:23:40 [DEBUG   ] Got command RPT from MCS: ref #1236625
2019-01-21 08:23:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 08:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236625  12 58504 30220973 A  ERRORB—™š'
2019-01-21 08:24:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 08:24:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 08:24:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:24:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:24:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:24:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:24:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:24:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:24:23 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-01-21 08:24:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 08:25:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 08:25:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 08:25:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:25:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:25:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:25:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:25:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:25:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:25:23 [DEBUG   ] Finished updating board flags in 1.801 seconds
2019-01-21 08:25:41 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 08:26:01 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 08:26:06 [DEBUG   ] Got command RPT from MCS: ref #1236630
2019-01-21 08:26:06 [DEBUG   ] summary = ERROR
2019-01-21 08:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236630  13 58504 30366913 A  ERRORERROR'
2019-01-21 08:26:06 [DEBUG   ] Got command RPT from MCS: ref #1236631
2019-01-21 08:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236631  77 58504 30366914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:26:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 08:26:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:26:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:26:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:26:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:26:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:26:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:26:23 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-01-21 08:26:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 08:27:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 08:27:21 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 08:27:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:27:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:27:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:27:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:27:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:27:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:27:23 [DEBUG   ] Finished updating board flags in 1.631 seconds
2019-01-21 08:27:41 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 08:28:01 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-21 08:28:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 08:28:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:28:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:28:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:28:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:28:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:28:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:28:23 [DEBUG   ] Finished updating board flags in 1.574 seconds
2019-01-21 08:28:40 [DEBUG   ] Got command RPT from MCS: ref #1236649
2019-01-21 08:28:40 [DEBUG   ] summary = ERROR
2019-01-21 08:28:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236649  13 58504 30520261 A  ERRORERROR'
2019-01-21 08:28:40 [DEBUG   ] Got command RPT from MCS: ref #1236650
2019-01-21 08:28:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:28:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236650  77 58504 30520453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:28:40 [DEBUG   ] Got command RPT from MCS: ref #1236651
2019-01-21 08:28:40 [DEBUG   ] summary = ERROR
2019-01-21 08:28:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236651  13 58504 30520657 A  ERRORERROR'
2019-01-21 08:28:40 [DEBUG   ] Got command RPT from MCS: ref #1236653
2019-01-21 08:28:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:28:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236653  77 58504 30520861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:28:41 [DEBUG   ] Got command RPT from MCS: ref #1236654
2019-01-21 08:28:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 08:28:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236654  12 58504 30521057 A  ERRORB–™š'
2019-01-21 08:28:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 08:29:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 08:29:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 08:29:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:29:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:29:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:29:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:29:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:29:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:29:23 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-21 08:29:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 08:30:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 08:30:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 08:30:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:30:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:30:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:30:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:30:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:30:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:30:23 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-21 08:30:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 08:31:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 08:31:06 [DEBUG   ] Got command RPT from MCS: ref #1236663
2019-01-21 08:31:06 [DEBUG   ] summary = ERROR
2019-01-21 08:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236663  13 58504 30666925 A  ERRORERROR'
2019-01-21 08:31:06 [DEBUG   ] Got command RPT from MCS: ref #1236664
2019-01-21 08:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236664  77 58504 30666926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:31:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 08:31:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:31:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:31:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:31:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:31:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:31:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:31:23 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-01-21 08:31:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 08:32:02 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-21 08:32:22 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 08:32:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:32:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:32:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:32:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:32:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:32:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:32:23 [DEBUG   ] Finished updating board flags in 1.435 seconds
2019-01-21 08:32:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 08:33:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 08:33:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 08:33:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:33:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:33:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:33:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:33:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:33:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:33:23 [DEBUG   ] Finished updating board flags in 1.504 seconds
2019-01-21 08:33:40 [DEBUG   ] Got command RPT from MCS: ref #1236684
2019-01-21 08:33:40 [DEBUG   ] summary = ERROR
2019-01-21 08:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236684  13 58504 30820349 A  ERRORERROR'
2019-01-21 08:33:40 [DEBUG   ] Got command RPT from MCS: ref #1236685
2019-01-21 08:33:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236685  77 58504 30820541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:33:40 [DEBUG   ] Got command RPT from MCS: ref #1236686
2019-01-21 08:33:40 [DEBUG   ] summary = ERROR
2019-01-21 08:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236686  13 58504 30820745 A  ERRORERROR'
2019-01-21 08:33:40 [DEBUG   ] Got command RPT from MCS: ref #1236687
2019-01-21 08:33:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236687  77 58504 30820949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:33:41 [DEBUG   ] Got command RPT from MCS: ref #1236688
2019-01-21 08:33:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 08:33:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236688  12 58504 30821154 A  ERRORB•™š'
2019-01-21 08:33:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 08:34:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 08:34:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 08:34:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:34:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:34:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:34:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:34:23 [WARNING ] (13, 1, 'bot')
2019-01-21 08:34:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:34:23 [DEBUG   ] Finished updating board flags in 1.508 seconds
2019-01-21 08:34:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 08:35:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 08:35:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 08:35:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 08:35:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:35:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:35:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:35:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:35:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:35:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:35:24 [DEBUG   ] Finished updating board flags in 2.196 seconds
2019-01-21 08:35:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 08:36:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 08:36:06 [DEBUG   ] Got command RPT from MCS: ref #1236693
2019-01-21 08:36:06 [DEBUG   ] summary = ERROR
2019-01-21 08:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236693  13 58504 30966917 A  ERRORERROR'
2019-01-21 08:36:06 [DEBUG   ] Got command RPT from MCS: ref #1236694
2019-01-21 08:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236694  77 58504 30966918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:36:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 08:36:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:36:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:36:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:36:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:36:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:36:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:36:24 [DEBUG   ] Finished updating board flags in 1.900 seconds
2019-01-21 08:36:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 08:37:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 08:37:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 08:37:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:37:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:37:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:37:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:37:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:37:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:37:24 [DEBUG   ] Finished updating board flags in 1.845 seconds
2019-01-21 08:37:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 08:38:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 08:38:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 08:38:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:38:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:38:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:38:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:38:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:38:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:38:24 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-01-21 08:38:40 [DEBUG   ] Got command RPT from MCS: ref #1236716
2019-01-21 08:38:40 [DEBUG   ] summary = ERROR
2019-01-21 08:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236716  13 58504 31120433 A  ERRORERROR'
2019-01-21 08:38:40 [DEBUG   ] Got command RPT from MCS: ref #1236717
2019-01-21 08:38:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236717  77 58504 31120625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:38:40 [DEBUG   ] Got command RPT from MCS: ref #1236718
2019-01-21 08:38:40 [DEBUG   ] summary = ERROR
2019-01-21 08:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236718  13 58504 31120829 A  ERRORERROR'
2019-01-21 08:38:41 [DEBUG   ] Got command RPT from MCS: ref #1236720
2019-01-21 08:38:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:38:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236720  77 58504 31121033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:38:41 [DEBUG   ] Got command RPT from MCS: ref #1236721
2019-01-21 08:38:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 08:38:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236721  12 58504 31121237 A  ERRORB—™š'
2019-01-21 08:38:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 08:39:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 08:39:22 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-21 08:39:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:39:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:39:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:39:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:39:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:39:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:39:24 [DEBUG   ] Finished updating board flags in 1.743 seconds
2019-01-21 08:39:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 08:40:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 08:40:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 08:40:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:40:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:40:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:40:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:40:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:40:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:40:24 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-21 08:40:43 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 08:41:03 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 08:41:06 [DEBUG   ] Got command RPT from MCS: ref #1236730
2019-01-21 08:41:06 [DEBUG   ] summary = ERROR
2019-01-21 08:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236730  13 58504 31266921 A  ERRORERROR'
2019-01-21 08:41:06 [DEBUG   ] Got command RPT from MCS: ref #1236731
2019-01-21 08:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236731  77 58504 31266922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:41:23 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2019-01-21 08:41:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:41:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 08:41:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:41:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:41:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:41:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:41:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:41:24 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-01-21 08:41:43 [DEBUG   ] Finished updating ant stats in 1.153 seconds
2019-01-21 08:42:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 08:42:23 [DEBUG   ] Finished updating ant stats in 1.051 seconds
2019-01-21 08:42:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:42:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:42:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:42:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:42:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:42:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:42:24 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-21 08:42:43 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2019-01-21 08:43:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 08:43:23 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2019-01-21 08:43:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:43:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:43:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:43:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:43:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:43:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:43:24 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-01-21 08:43:40 [DEBUG   ] Got command RPT from MCS: ref #1236747
2019-01-21 08:43:40 [DEBUG   ] summary = ERROR
2019-01-21 08:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236747  13 58504 31420513 A  ERRORERROR'
2019-01-21 08:43:40 [DEBUG   ] Got command RPT from MCS: ref #1236748
2019-01-21 08:43:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236748  77 58504 31420717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:43:40 [DEBUG   ] Got command RPT from MCS: ref #1236749
2019-01-21 08:43:40 [DEBUG   ] summary = ERROR
2019-01-21 08:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236749  13 58504 31420921 A  ERRORERROR'
2019-01-21 08:43:41 [DEBUG   ] Got command RPT from MCS: ref #1236750
2019-01-21 08:43:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:43:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236750  77 58504 31421113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:43:41 [DEBUG   ] Got command RPT from MCS: ref #1236751
2019-01-21 08:43:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 08:43:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236751  12 58504 31421317 A  ERRORB–™š'
2019-01-21 08:43:43 [DEBUG   ] Finished updating ant stats in 0.772 seconds
2019-01-21 08:44:03 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 08:44:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:44:24 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 08:44:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:44:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:44:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:44:24 [WARNING ] (13, 1, 'bot')
2019-01-21 08:44:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:44:24 [DEBUG   ] Finished updating board flags in 1.352 seconds
2019-01-21 08:44:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 08:45:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 08:45:24 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2019-01-21 08:45:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:45:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:45:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:45:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:45:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:45:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:45:25 [DEBUG   ] Finished updating board flags in 2.116 seconds
2019-01-21 08:45:44 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2019-01-21 08:46:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 08:46:06 [DEBUG   ] Got command RPT from MCS: ref #1236756
2019-01-21 08:46:06 [DEBUG   ] summary = ERROR
2019-01-21 08:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236756  13 58504 31566929 A  ERRORERROR'
2019-01-21 08:46:06 [DEBUG   ] Got command RPT from MCS: ref #1236757
2019-01-21 08:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236757  77 58504 31566930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:46:24 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2019-01-21 08:46:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:46:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:46:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:46:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:46:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:46:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:46:25 [DEBUG   ] Finished updating board flags in 1.936 seconds
2019-01-21 08:46:44 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2019-01-21 08:47:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 08:47:24 [DEBUG   ] Finished updating ant stats in 0.850 seconds
2019-01-21 08:47:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:47:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:47:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:47:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:47:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:47:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:47:25 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-21 08:47:44 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2019-01-21 08:48:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 08:48:24 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2019-01-21 08:48:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:48:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:48:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:48:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:48:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:48:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:48:25 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-21 08:48:40 [DEBUG   ] Got command RPT from MCS: ref #1236779
2019-01-21 08:48:40 [DEBUG   ] summary = ERROR
2019-01-21 08:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236779  13 58504 31720605 A  ERRORERROR'
2019-01-21 08:48:40 [DEBUG   ] Got command RPT from MCS: ref #1236780
2019-01-21 08:48:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236780  77 58504 31720797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:48:41 [DEBUG   ] Got command RPT from MCS: ref #1236781
2019-01-21 08:48:41 [DEBUG   ] summary = ERROR
2019-01-21 08:48:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236781  13 58504 31721001 A  ERRORERROR'
2019-01-21 08:48:41 [DEBUG   ] Got command RPT from MCS: ref #1236783
2019-01-21 08:48:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:48:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236783  77 58504 31721205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:48:41 [DEBUG   ] Got command RPT from MCS: ref #1236784
2019-01-21 08:48:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 08:48:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236784  12 58504 31721409 A  ERRORB•™š'
2019-01-21 08:48:44 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2019-01-21 08:49:05 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 08:49:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:49:25 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2019-01-21 08:49:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 08:49:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:49:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:49:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:49:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:49:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:49:25 [DEBUG   ] Finished updating board flags in 1.673 seconds
2019-01-21 08:49:45 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2019-01-21 08:50:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 08:50:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:50:25 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2019-01-21 08:50:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:50:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:50:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:50:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:50:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:50:25 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-21 08:50:45 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-01-21 08:51:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-21 08:51:06 [DEBUG   ] Got command RPT from MCS: ref #1236793
2019-01-21 08:51:06 [DEBUG   ] summary = ERROR
2019-01-21 08:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236793  13 58504 31866921 A  ERRORERROR'
2019-01-21 08:51:06 [DEBUG   ] Got command RPT from MCS: ref #1236794
2019-01-21 08:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236794  77 58504 31866922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:51:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 08:51:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:51:25 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2019-01-21 08:51:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:51:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:51:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:51:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:51:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:51:25 [DEBUG   ] Finished updating board flags in 1.625 seconds
2019-01-21 08:51:45 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2019-01-21 08:52:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 08:52:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:52:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:52:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:52:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:52:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:52:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:52:25 [DEBUG   ] Finished updating board flags in 1.572 seconds
2019-01-21 08:52:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 08:52:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 08:53:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 08:53:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:53:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 08:53:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:53:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:53:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:53:25 [WARNING ] (13, 1, 'bot')
2019-01-21 08:53:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:53:25 [DEBUG   ] Finished updating board flags in 1.477 seconds
2019-01-21 08:53:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 08:53:40 [DEBUG   ] Got command RPT from MCS: ref #1236814
2019-01-21 08:53:40 [DEBUG   ] summary = ERROR
2019-01-21 08:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236814  13 58504 32020689 A  ERRORERROR'
2019-01-21 08:53:40 [DEBUG   ] Got command RPT from MCS: ref #1236815
2019-01-21 08:53:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236815  77 58504 32020881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:53:41 [DEBUG   ] Got command RPT from MCS: ref #1236816
2019-01-21 08:53:41 [DEBUG   ] summary = ERROR
2019-01-21 08:53:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236816  13 58504 32021085 A  ERRORERROR'
2019-01-21 08:53:41 [DEBUG   ] Got command RPT from MCS: ref #1236817
2019-01-21 08:53:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:53:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236817  77 58504 32021289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:53:41 [DEBUG   ] Got command RPT from MCS: ref #1236818
2019-01-21 08:53:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 08:53:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236818  12 58504 32021493 A  ERRORB—™š'
2019-01-21 08:53:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 08:54:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 08:54:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:54:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 08:54:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:54:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:54:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:54:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:54:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:54:26 [DEBUG   ] Finished updating board flags in 2.367 seconds
2019-01-21 08:54:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 08:55:06 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-21 08:55:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:55:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 08:55:26 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2019-01-21 08:55:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:55:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:55:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:55:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:55:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:55:26 [DEBUG   ] Finished updating board flags in 2.160 seconds
2019-01-21 08:55:46 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2019-01-21 08:56:06 [DEBUG   ] Got command RPT from MCS: ref #1236823
2019-01-21 08:56:06 [DEBUG   ] summary = ERROR
2019-01-21 08:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236823  13 58504 32166929 A  ERRORERROR'
2019-01-21 08:56:06 [DEBUG   ] Got command RPT from MCS: ref #1236824
2019-01-21 08:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236824  77 58504 32166930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:56:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 08:56:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:56:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:56:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:56:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:56:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:56:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:56:26 [DEBUG   ] Finished updating board flags in 2.028 seconds
2019-01-21 08:56:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 08:56:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 08:57:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 08:57:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:57:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:57:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:57:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:57:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:57:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:57:26 [DEBUG   ] Finished updating board flags in 1.967 seconds
2019-01-21 08:57:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 08:57:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 08:58:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 08:58:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:58:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 08:58:27 [WARNING ] (13, 1, 'bot')
2019-01-21 08:58:27 [WARNING ] (13, 1, 'bot')
2019-01-21 08:58:27 [WARNING ] (13, 1, 'bot')
2019-01-21 08:58:27 [WARNING ] (13, 1, 'bot')
2019-01-21 08:58:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:58:27 [DEBUG   ] Finished updating board flags in 2.926 seconds
2019-01-21 08:58:40 [DEBUG   ] Got command RPT from MCS: ref #1236842
2019-01-21 08:58:40 [DEBUG   ] summary = ERROR
2019-01-21 08:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236842  13 58504 32320777 A  ERRORERROR'
2019-01-21 08:58:40 [DEBUG   ] Got command RPT from MCS: ref #1236843
2019-01-21 08:58:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236843  77 58504 32320969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:58:41 [DEBUG   ] Got command RPT from MCS: ref #1236844
2019-01-21 08:58:41 [DEBUG   ] summary = ERROR
2019-01-21 08:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236844  13 58504 32321173 A  ERRORERROR'
2019-01-21 08:58:41 [DEBUG   ] Got command RPT from MCS: ref #1236846
2019-01-21 08:58:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 08:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236846  77 58504 32321377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 08:58:41 [DEBUG   ] Got command RPT from MCS: ref #1236847
2019-01-21 08:58:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 08:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236847  12 58504 32321581 A  ERRORB–™š'
2019-01-21 08:58:47 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-21 08:59:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 08:59:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 08:59:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:59:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:59:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:59:26 [WARNING ] (13, 1, 'bot')
2019-01-21 08:59:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 08:59:26 [DEBUG   ] Finished updating board flags in 1.685 seconds
2019-01-21 08:59:27 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-21 08:59:47 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 09:00:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 09:00:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:00:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:00:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:00:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:00:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:00:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:00:26 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-01-21 09:00:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 09:00:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 09:01:06 [DEBUG   ] Got command RPT from MCS: ref #1236856
2019-01-21 09:01:06 [DEBUG   ] summary = ERROR
2019-01-21 09:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236856  13 58504 32466922 A  ERRORERROR'
2019-01-21 09:01:06 [DEBUG   ] Got command RPT from MCS: ref #1236857
2019-01-21 09:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236857  77 58504 32466922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:01:08 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 09:01:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:01:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:01:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:01:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:01:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:01:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:01:26 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-01-21 09:01:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 09:01:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 09:02:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 09:02:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:02:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:02:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:02:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:02:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:02:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:02:26 [DEBUG   ] Finished updating board flags in 1.437 seconds
2019-01-21 09:02:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 09:02:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 09:03:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 09:03:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:03:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:03:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:03:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:03:26 [WARNING ] (13, 1, 'bot')
2019-01-21 09:03:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:03:26 [DEBUG   ] Finished updating board flags in 1.490 seconds
2019-01-21 09:03:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 09:03:40 [DEBUG   ] Got command RPT from MCS: ref #1236877
2019-01-21 09:03:40 [DEBUG   ] summary = ERROR
2019-01-21 09:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236877  13 58504 32620857 A  ERRORERROR'
2019-01-21 09:03:41 [DEBUG   ] Got command RPT from MCS: ref #1236878
2019-01-21 09:03:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:03:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236878  77 58504 32621065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:03:41 [DEBUG   ] Got command RPT from MCS: ref #1236879
2019-01-21 09:03:41 [DEBUG   ] summary = ERROR
2019-01-21 09:03:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236879  13 58504 32621257 A  ERRORERROR'
2019-01-21 09:03:41 [DEBUG   ] Got command RPT from MCS: ref #1236880
2019-01-21 09:03:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:03:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236880  77 58504 32621461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:03:41 [DEBUG   ] Got command RPT from MCS: ref #1236881
2019-01-21 09:03:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 09:03:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236881  12 58504 32621665 A  ERRORB–™š'
2019-01-21 09:03:48 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 09:04:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 09:04:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:04:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:04:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:04:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:04:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:04:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:04:27 [DEBUG   ] Finished updating board flags in 2.284 seconds
2019-01-21 09:04:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 09:04:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 09:05:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:05:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:05:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:05:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:05:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:05:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:05:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:05:27 [DEBUG   ] Finished updating board flags in 2.247 seconds
2019-01-21 09:05:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 09:05:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 09:06:06 [DEBUG   ] Got command RPT from MCS: ref #1236886
2019-01-21 09:06:06 [DEBUG   ] summary = ERROR
2019-01-21 09:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236886  13 58504 32766933 A  ERRORERROR'
2019-01-21 09:06:06 [DEBUG   ] Got command RPT from MCS: ref #1236887
2019-01-21 09:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236887  77 58504 32766934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:06:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 09:06:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 09:06:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:06:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:06:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:06:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:06:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:06:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:06:27 [DEBUG   ] Finished updating board flags in 2.121 seconds
2019-01-21 09:06:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 09:06:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:07:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 09:07:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:07:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:07:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:07:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:07:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:07:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:07:27 [DEBUG   ] Finished updating board flags in 2.062 seconds
2019-01-21 09:07:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:07:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:08:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:08:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:08:28 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-21 09:08:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:08:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:08:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:08:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:08:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:08:28 [DEBUG   ] Finished updating board flags in 2.882 seconds
2019-01-21 09:08:40 [DEBUG   ] Got command RPT from MCS: ref #1236909
2019-01-21 09:08:40 [DEBUG   ] summary = ERROR
2019-01-21 09:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236909  13 58504 32920941 A  ERRORERROR'
2019-01-21 09:08:41 [DEBUG   ] Got command RPT from MCS: ref #1236910
2019-01-21 09:08:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:08:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236910  77 58504 32921145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:08:41 [DEBUG   ] Got command RPT from MCS: ref #1236911
2019-01-21 09:08:41 [DEBUG   ] summary = ERROR
2019-01-21 09:08:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236911  13 58504 32921349 A  ERRORERROR'
2019-01-21 09:08:41 [DEBUG   ] Got command RPT from MCS: ref #1236913
2019-01-21 09:08:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:08:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236913  77 58504 32921541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:08:41 [DEBUG   ] Got command RPT from MCS: ref #1236915
2019-01-21 09:08:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 09:08:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236915  12 58504 32921767 A  ERRORB˜™š'
2019-01-21 09:08:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 09:09:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:09:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:09:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:09:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:09:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:09:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:09:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:09:27 [DEBUG   ] Finished updating board flags in 1.867 seconds
2019-01-21 09:09:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:09:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 09:10:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 09:10:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:10:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 09:10:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:10:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:10:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:10:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:10:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:10:27 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-21 09:10:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:10:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:11:06 [DEBUG   ] Got command RPT from MCS: ref #1236923
2019-01-21 09:11:06 [DEBUG   ] summary = ERROR
2019-01-21 09:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236923  13 58504 33066925 A  ERRORERROR'
2019-01-21 09:11:06 [DEBUG   ] Got command RPT from MCS: ref #1236924
2019-01-21 09:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236924  77 58504 33066926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:11:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 09:11:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:11:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:11:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:11:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:11:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:11:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:11:27 [DEBUG   ] Finished updating board flags in 1.566 seconds
2019-01-21 09:11:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 09:11:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:12:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:12:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:12:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:12:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:12:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:12:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:12:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:12:27 [DEBUG   ] Finished updating board flags in 1.483 seconds
2019-01-21 09:12:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 09:12:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 09:13:09 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 09:13:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:13:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:13:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:13:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:13:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:13:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:13:27 [DEBUG   ] Finished updating board flags in 1.461 seconds
2019-01-21 09:13:29 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 09:13:41 [DEBUG   ] Got command RPT from MCS: ref #1236940
2019-01-21 09:13:41 [DEBUG   ] summary = ERROR
2019-01-21 09:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236940  13 58504 33221030 A  ERRORERROR'
2019-01-21 09:13:41 [DEBUG   ] Got command RPT from MCS: ref #1236941
2019-01-21 09:13:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236941  77 58504 33221233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:13:41 [DEBUG   ] Got command RPT from MCS: ref #1236942
2019-01-21 09:13:41 [DEBUG   ] summary = ERROR
2019-01-21 09:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236942  13 58504 33221426 A  ERRORERROR'
2019-01-21 09:13:41 [DEBUG   ] Got command RPT from MCS: ref #1236943
2019-01-21 09:13:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236943  77 58504 33221629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:13:41 [DEBUG   ] Got command RPT from MCS: ref #1236944
2019-01-21 09:13:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 09:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236944  12 58504 33221833 A  ERRORB—™š'
2019-01-21 09:13:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 09:14:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:14:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:14:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:14:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:14:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:14:27 [WARNING ] (13, 1, 'bot')
2019-01-21 09:14:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:14:27 [DEBUG   ] Finished updating board flags in 1.472 seconds
2019-01-21 09:14:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:14:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 09:15:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 09:15:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:15:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:15:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:15:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:15:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:15:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:15:28 [DEBUG   ] Finished updating board flags in 2.271 seconds
2019-01-21 09:15:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 09:15:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 09:16:06 [DEBUG   ] Got command RPT from MCS: ref #1236949
2019-01-21 09:16:06 [DEBUG   ] summary = ERROR
2019-01-21 09:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236949  13 58504 33366929 A  ERRORERROR'
2019-01-21 09:16:06 [DEBUG   ] Got command RPT from MCS: ref #1236950
2019-01-21 09:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236950  77 58504 33366930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:16:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 09:16:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:16:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:16:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:16:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:16:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:16:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:16:28 [DEBUG   ] Finished updating board flags in 2.175 seconds
2019-01-21 09:16:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 09:16:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:17:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 09:17:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:17:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:17:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:17:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:17:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:17:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:17:28 [DEBUG   ] Finished updating board flags in 2.045 seconds
2019-01-21 09:17:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 09:17:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 09:18:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 09:18:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:18:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:18:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:18:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:18:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:18:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:18:28 [DEBUG   ] Finished updating board flags in 2.018 seconds
2019-01-21 09:18:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:18:41 [DEBUG   ] Got command RPT from MCS: ref #1236972
2019-01-21 09:18:41 [DEBUG   ] summary = ERROR
2019-01-21 09:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236972  13 58504 33521118 A  ERRORERROR'
2019-01-21 09:18:41 [DEBUG   ] Got command RPT from MCS: ref #1236973
2019-01-21 09:18:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236973  77 58504 33521309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:18:41 [DEBUG   ] Got command RPT from MCS: ref #1236974
2019-01-21 09:18:41 [DEBUG   ] summary = ERROR
2019-01-21 09:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236974  13 58504 33521513 A  ERRORERROR'
2019-01-21 09:18:41 [DEBUG   ] Got command RPT from MCS: ref #1236976
2019-01-21 09:18:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236976  77 58504 33521717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:18:41 [DEBUG   ] Got command RPT from MCS: ref #1236978
2019-01-21 09:18:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 09:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236978  12 58504 33521909 A  ERRORB•™š'
2019-01-21 09:18:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 09:19:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 09:19:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:19:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:19:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:19:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:19:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:19:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:19:28 [DEBUG   ] Finished updating board flags in 1.946 seconds
2019-01-21 09:19:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:19:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:20:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 09:20:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 09:20:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:20:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:20:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:20:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:20:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:20:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:20:28 [DEBUG   ] Finished updating board flags in 1.859 seconds
2019-01-21 09:20:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 09:20:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:21:06 [DEBUG   ] Got command RPT from MCS: ref #1236986
2019-01-21 09:21:06 [DEBUG   ] summary = ERROR
2019-01-21 09:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236986  13 58504 33666933 A  ERRORERROR'
2019-01-21 09:21:06 [DEBUG   ] Got command RPT from MCS: ref #1236987
2019-01-21 09:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1236987  77 58504 33666934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:21:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 09:21:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:21:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:21:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:21:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:21:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:21:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:21:28 [DEBUG   ] Finished updating board flags in 1.687 seconds
2019-01-21 09:21:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 09:21:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 09:22:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 09:22:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:22:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:22:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:22:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:22:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:22:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:22:28 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-21 09:22:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 09:22:50 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-21 09:23:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:23:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:23:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:23:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:23:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:23:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:23:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:23:28 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-21 09:23:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 09:23:41 [DEBUG   ] Got command RPT from MCS: ref #1237007
2019-01-21 09:23:41 [DEBUG   ] summary = ERROR
2019-01-21 09:23:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237007  13 58504 33821201 A  ERRORERROR'
2019-01-21 09:23:41 [DEBUG   ] Got command RPT from MCS: ref #1237008
2019-01-21 09:23:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:23:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237008  77 58504 33821393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:23:41 [DEBUG   ] Got command RPT from MCS: ref #1237009
2019-01-21 09:23:41 [DEBUG   ] summary = ERROR
2019-01-21 09:23:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237009  13 58504 33821597 A  ERRORERROR'
2019-01-21 09:23:41 [DEBUG   ] Got command RPT from MCS: ref #1237010
2019-01-21 09:23:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:23:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237010  77 58504 33821801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:23:42 [DEBUG   ] Got command RPT from MCS: ref #1237011
2019-01-21 09:23:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 09:23:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237011  12 58504 33822005 A  ERRORB—™š'
2019-01-21 09:23:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 09:24:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 09:24:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:24:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 09:24:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:24:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:24:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:24:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:24:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:24:28 [DEBUG   ] Finished updating board flags in 1.578 seconds
2019-01-21 09:24:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:24:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 09:25:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 09:25:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:25:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:25:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:25:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:25:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:25:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:25:28 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-21 09:25:30 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-21 09:25:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 09:26:06 [DEBUG   ] Got command RPT from MCS: ref #1237016
2019-01-21 09:26:06 [DEBUG   ] summary = ERROR
2019-01-21 09:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237016  13 58504 33966929 A  ERRORERROR'
2019-01-21 09:26:06 [DEBUG   ] Got command RPT from MCS: ref #1237017
2019-01-21 09:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237017  77 58504 33966930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:26:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-21 09:26:11 [DEBUG   ] Got command TBW from MCS: ref #1237034
2019-01-21 09:26:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-21 09:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1237034   8 58504 33971817 A  ERROR'
2019-01-21 09:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-21 09:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-21 09:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-21 09:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-21 09:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-21 09:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-21 09:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-21 09:26:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-21 09:26:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-21 09:26:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-21 09:26:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-21 09:26:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-21 09:26:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-21 09:26:15 [DEBUG   ] spawn_process: at 2019-01-21 09:26:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-21 09:26:15 [INFO    ] Finished spawning TBW
2019-01-21 09:26:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:26:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 09:26:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:26:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:26:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:26:28 [WARNING ] (13, 1, 'bot')
2019-01-21 09:26:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:26:28 [DEBUG   ] Finished updating board flags in 1.194 seconds
2019-01-21 09:27:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:27:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:27:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:27:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:27:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:27:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:27:29 [DEBUG   ] Finished updating board flags in 2.174 seconds
2019-01-21 09:28:03 [INFO    ] __waitForTBW - TBW finished in 108.578 s
2019-01-21 09:28:04 [DEBUG   ] Finished updating ant stats in 0.377 seconds
2019-01-21 09:28:04 [INFO    ] Started antennas statistics background thread
2019-01-21 09:28:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1548062886']
2019-01-21 09:28:04 [DEBUG   ] spawn_process: at 2019-01-21 09:28:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1548062886']
2019-01-21 09:28:04 [INFO    ] Finished spawning TBN in 0.049 s
2019-01-21 09:28:25 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2019-01-21 09:28:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:28:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:28:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:28:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:28:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:28:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:28:29 [DEBUG   ] Finished updating board flags in 2.157 seconds
2019-01-21 09:28:41 [DEBUG   ] Got command RPT from MCS: ref #1237042
2019-01-21 09:28:41 [DEBUG   ] summary = ERROR
2019-01-21 09:28:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237042  13 58504 34121281 A  ERRORERROR'
2019-01-21 09:28:41 [DEBUG   ] Got command RPT from MCS: ref #1237043
2019-01-21 09:28:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:28:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237043  77 58504 34121485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:28:41 [DEBUG   ] Got command RPT from MCS: ref #1237044
2019-01-21 09:28:41 [DEBUG   ] summary = ERROR
2019-01-21 09:28:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237044  13 58504 34121689 A  ERRORERROR'
2019-01-21 09:28:41 [DEBUG   ] Got command RPT from MCS: ref #1237046
2019-01-21 09:28:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:28:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237046  77 58504 34121881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:28:42 [DEBUG   ] Got command RPT from MCS: ref #1237048
2019-01-21 09:28:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 09:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237048  12 58504 34122085 A  ERRORB–™š'
2019-01-21 09:28:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 09:29:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 09:29:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:29:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:29:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:29:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:29:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:29:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:29:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:29:29 [DEBUG   ] Finished updating board flags in 1.865 seconds
2019-01-21 09:29:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:30:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 09:30:25 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-21 09:30:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:30:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:30:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:30:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:30:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:30:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:30:29 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-21 09:30:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:31:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:31:06 [DEBUG   ] Got command RPT from MCS: ref #1237058
2019-01-21 09:31:06 [DEBUG   ] summary = ERROR
2019-01-21 09:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237058  13 58504 34266937 A  ERRORERROR'
2019-01-21 09:31:06 [DEBUG   ] Got command RPT from MCS: ref #1237059
2019-01-21 09:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237059  77 58504 34266938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:31:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 09:31:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:31:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:31:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:31:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:31:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:31:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:31:29 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-01-21 09:31:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-21 09:32:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:32:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:32:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:32:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:32:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:32:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:32:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:32:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:32:29 [DEBUG   ] Finished updating board flags in 1.627 seconds
2019-01-21 09:32:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 09:33:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 09:33:26 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 09:33:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:33:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:33:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:33:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:33:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:33:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:33:29 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-01-21 09:33:41 [DEBUG   ] Got command RPT from MCS: ref #1237079
2019-01-21 09:33:41 [DEBUG   ] summary = ERROR
2019-01-21 09:33:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237079  13 58504 34421369 A  ERRORERROR'
2019-01-21 09:33:41 [DEBUG   ] Got command RPT from MCS: ref #1237080
2019-01-21 09:33:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:33:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237080  77 58504 34421573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:33:41 [DEBUG   ] Got command RPT from MCS: ref #1237081
2019-01-21 09:33:41 [DEBUG   ] summary = ERROR
2019-01-21 09:33:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237081  13 58504 34421777 A  ERRORERROR'
2019-01-21 09:33:41 [DEBUG   ] Got command RPT from MCS: ref #1237082
2019-01-21 09:33:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:33:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237082  77 58504 34421969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:33:42 [DEBUG   ] Got command RPT from MCS: ref #1237083
2019-01-21 09:33:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 09:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237083  12 58504 34422173 A  ERRORB•™š'
2019-01-21 09:33:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 09:34:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 09:34:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:34:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:34:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:34:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:34:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:34:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:34:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:34:29 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-21 09:34:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 09:35:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 09:35:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:35:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:35:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:35:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:35:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:35:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:35:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:35:29 [DEBUG   ] Finished updating board flags in 1.462 seconds
2019-01-21 09:35:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 09:36:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 09:36:06 [DEBUG   ] Got command RPT from MCS: ref #1237088
2019-01-21 09:36:06 [DEBUG   ] summary = ERROR
2019-01-21 09:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237088  13 58504 34566941 A  ERRORERROR'
2019-01-21 09:36:06 [DEBUG   ] Got command RPT from MCS: ref #1237089
2019-01-21 09:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237089  77 58504 34566942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:36:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 09:36:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:36:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-21 09:36:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 09:36:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:36:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:36:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:36:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:36:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:36:29 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-01-21 09:36:46 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-21 09:37:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:37:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 09:37:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:37:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:37:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:37:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:37:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:37:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:37:29 [DEBUG   ] Finished updating board flags in 1.437 seconds
2019-01-21 09:37:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 09:38:06 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-21 09:38:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 09:38:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:38:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:38:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:38:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:38:29 [WARNING ] (13, 1, 'bot')
2019-01-21 09:38:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:38:29 [DEBUG   ] Finished updating board flags in 1.444 seconds
2019-01-21 09:38:41 [DEBUG   ] Got command RPT from MCS: ref #1237111
2019-01-21 09:38:41 [DEBUG   ] summary = ERROR
2019-01-21 09:38:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237111  13 58504 34721457 A  ERRORERROR'
2019-01-21 09:38:41 [DEBUG   ] Got command RPT from MCS: ref #1237112
2019-01-21 09:38:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:38:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237112  77 58504 34721661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:38:41 [DEBUG   ] Got command RPT from MCS: ref #1237113
2019-01-21 09:38:41 [DEBUG   ] summary = ERROR
2019-01-21 09:38:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237113  13 58504 34721853 A  ERRORERROR'
2019-01-21 09:38:42 [DEBUG   ] Got command RPT from MCS: ref #1237115
2019-01-21 09:38:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237115  77 58504 34722057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:38:42 [DEBUG   ] Got command RPT from MCS: ref #1237116
2019-01-21 09:38:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 09:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237116  12 58504 34722261 A  ERRORB—™š'
2019-01-21 09:38:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 09:39:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 09:39:27 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 09:39:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:39:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:39:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:39:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:39:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:39:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:39:30 [DEBUG   ] Finished updating board flags in 2.264 seconds
2019-01-21 09:39:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 09:40:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 09:40:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:40:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:40:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 09:40:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:40:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:40:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:40:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:40:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:40:30 [DEBUG   ] Finished updating board flags in 2.135 seconds
2019-01-21 09:40:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 09:41:06 [DEBUG   ] Got command RPT from MCS: ref #1237125
2019-01-21 09:41:06 [DEBUG   ] summary = ERROR
2019-01-21 09:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237125  13 58504 34866945 A  ERRORERROR'
2019-01-21 09:41:06 [DEBUG   ] Got command RPT from MCS: ref #1237126
2019-01-21 09:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237126  77 58504 34866946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:41:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 09:41:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 09:41:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:41:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:41:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:41:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:41:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:41:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:41:30 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-01-21 09:41:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:42:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:42:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 09:42:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:42:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:42:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:42:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:42:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:42:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:42:30 [DEBUG   ] Finished updating board flags in 1.998 seconds
2019-01-21 09:42:47 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 09:43:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 09:43:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:43:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:43:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:43:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:43:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:43:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:43:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:43:30 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-21 09:43:41 [DEBUG   ] Got command RPT from MCS: ref #1237142
2019-01-21 09:43:41 [DEBUG   ] summary = ERROR
2019-01-21 09:43:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237142  13 58504 35021537 A  ERRORERROR'
2019-01-21 09:43:41 [DEBUG   ] Got command RPT from MCS: ref #1237143
2019-01-21 09:43:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:43:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237143  77 58504 35021741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:43:41 [DEBUG   ] Got command RPT from MCS: ref #1237144
2019-01-21 09:43:41 [DEBUG   ] summary = ERROR
2019-01-21 09:43:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237144  13 58504 35021945 A  ERRORERROR'
2019-01-21 09:43:42 [DEBUG   ] Got command RPT from MCS: ref #1237145
2019-01-21 09:43:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237145  77 58504 35022137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:43:42 [DEBUG   ] Got command RPT from MCS: ref #1237146
2019-01-21 09:43:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 09:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237146  12 58504 35022341 A  ERRORB—™š'
2019-01-21 09:43:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 09:44:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 09:44:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-21 09:44:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:44:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:44:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:44:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:44:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:44:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:44:30 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-21 09:44:48 [DEBUG   ] Finished updating ant stats in 1.389 seconds
2019-01-21 09:45:08 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2019-01-21 09:45:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:45:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:45:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:45:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:45:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:45:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:45:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:45:30 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-21 09:45:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:46:06 [DEBUG   ] Got command RPT from MCS: ref #1237151
2019-01-21 09:46:06 [DEBUG   ] summary = ERROR
2019-01-21 09:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237151  13 58504 35166941 A  ERRORERROR'
2019-01-21 09:46:06 [DEBUG   ] Got command RPT from MCS: ref #1237152
2019-01-21 09:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237152  77 58504 35166942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:46:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 09:46:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 09:46:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:46:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:46:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:46:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:46:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:46:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:46:30 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-21 09:46:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 09:47:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 09:47:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 09:47:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:47:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:47:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:47:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:47:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:47:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:47:30 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-21 09:47:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 09:48:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:48:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:48:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:48:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:48:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:48:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:48:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:48:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:48:30 [DEBUG   ] Finished updating board flags in 1.558 seconds
2019-01-21 09:48:41 [DEBUG   ] Got command RPT from MCS: ref #1237174
2019-01-21 09:48:41 [DEBUG   ] summary = ERROR
2019-01-21 09:48:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237174  13 58504 35321621 A  ERRORERROR'
2019-01-21 09:48:41 [DEBUG   ] Got command RPT from MCS: ref #1237175
2019-01-21 09:48:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:48:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237175  77 58504 35321825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:48:42 [DEBUG   ] Got command RPT from MCS: ref #1237176
2019-01-21 09:48:42 [DEBUG   ] summary = ERROR
2019-01-21 09:48:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237176  13 58504 35322029 A  ERRORERROR'
2019-01-21 09:48:42 [DEBUG   ] Got command RPT from MCS: ref #1237178
2019-01-21 09:48:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:48:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237178  77 58504 35322233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:48:42 [DEBUG   ] Got command RPT from MCS: ref #1237179
2019-01-21 09:48:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 09:48:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237179  12 58504 35322425 A  ERRORB–™š'
2019-01-21 09:48:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 09:49:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 09:49:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:49:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:49:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:49:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:49:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:49:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:49:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:49:30 [DEBUG   ] Finished updating board flags in 1.474 seconds
2019-01-21 09:49:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:50:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 09:50:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 09:50:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:50:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 09:50:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:50:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:50:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:50:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:50:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:50:30 [DEBUG   ] Finished updating board flags in 1.517 seconds
2019-01-21 09:50:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:51:06 [DEBUG   ] Got command RPT from MCS: ref #1237188
2019-01-21 09:51:06 [DEBUG   ] summary = ERROR
2019-01-21 09:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237188  13 58504 35466937 A  ERRORERROR'
2019-01-21 09:51:06 [DEBUG   ] Got command RPT from MCS: ref #1237189
2019-01-21 09:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237189  77 58504 35466938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:51:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 09:51:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 09:51:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:51:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:51:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:51:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:51:30 [WARNING ] (13, 1, 'bot')
2019-01-21 09:51:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:51:30 [DEBUG   ] Finished updating board flags in 1.545 seconds
2019-01-21 09:51:48 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-21 09:52:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:52:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:52:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:52:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 09:52:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:52:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:52:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:52:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:52:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:52:31 [DEBUG   ] Finished updating board flags in 2.158 seconds
2019-01-21 09:52:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 09:53:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 09:53:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:53:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:53:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 09:53:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:53:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:53:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:53:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:53:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:53:31 [DEBUG   ] Finished updating board flags in 2.027 seconds
2019-01-21 09:53:41 [DEBUG   ] Got command RPT from MCS: ref #1237209
2019-01-21 09:53:41 [DEBUG   ] summary = ERROR
2019-01-21 09:53:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237209  13 58504 35621709 A  ERRORERROR'
2019-01-21 09:53:41 [DEBUG   ] Got command RPT from MCS: ref #1237210
2019-01-21 09:53:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:53:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237210  77 58504 35621913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:53:42 [DEBUG   ] Got command RPT from MCS: ref #1237211
2019-01-21 09:53:42 [DEBUG   ] summary = ERROR
2019-01-21 09:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237211  13 58504 35622117 A  ERRORERROR'
2019-01-21 09:53:42 [DEBUG   ] Got command RPT from MCS: ref #1237212
2019-01-21 09:53:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237212  77 58504 35622309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:53:42 [DEBUG   ] Got command RPT from MCS: ref #1237213
2019-01-21 09:53:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 09:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237213  12 58504 35622513 A  ERRORB–™š'
2019-01-21 09:53:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:54:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 09:54:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 09:54:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:54:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:54:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:54:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:54:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:54:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:54:31 [DEBUG   ] Finished updating board flags in 1.890 seconds
2019-01-21 09:54:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:55:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 09:55:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 09:55:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:55:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:55:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:55:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:55:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:55:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:55:31 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-21 09:55:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 09:56:06 [DEBUG   ] Got command RPT from MCS: ref #1237218
2019-01-21 09:56:06 [DEBUG   ] summary = ERROR
2019-01-21 09:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237218  13 58504 35766937 A  ERRORERROR'
2019-01-21 09:56:06 [DEBUG   ] Got command RPT from MCS: ref #1237219
2019-01-21 09:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237219  77 58504 35766938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:56:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:56:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:56:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:56:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:56:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:56:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:56:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:56:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:56:31 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-21 09:56:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 09:57:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 09:57:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:57:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:57:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 09:57:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:57:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:57:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:57:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:57:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:57:31 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-21 09:57:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:58:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 09:58:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 09:58:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:58:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:58:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:58:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:58:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:58:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:58:31 [DEBUG   ] Finished updating board flags in 1.712 seconds
2019-01-21 09:58:41 [DEBUG   ] Got command RPT from MCS: ref #1237237
2019-01-21 09:58:41 [DEBUG   ] summary = ERROR
2019-01-21 09:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237237  13 58504 35921797 A  ERRORERROR'
2019-01-21 09:58:41 [DEBUG   ] Got command RPT from MCS: ref #1237238
2019-01-21 09:58:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237238  77 58504 35921989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:58:42 [DEBUG   ] Got command RPT from MCS: ref #1237239
2019-01-21 09:58:42 [DEBUG   ] summary = ERROR
2019-01-21 09:58:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237239  13 58504 35922193 A  ERRORERROR'
2019-01-21 09:58:42 [DEBUG   ] Got command RPT from MCS: ref #1237240
2019-01-21 09:58:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 09:58:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237240  77 58504 35922397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 09:58:42 [DEBUG   ] Got command RPT from MCS: ref #1237242
2019-01-21 09:58:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 09:58:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237242  12 58504 35922601 A  ERRORB—™š'
2019-01-21 09:58:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 09:59:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 09:59:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 09:59:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 09:59:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:59:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:59:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:59:31 [WARNING ] (13, 1, 'bot')
2019-01-21 09:59:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 09:59:31 [DEBUG   ] Finished updating board flags in 1.476 seconds
2019-01-21 09:59:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 10:00:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 10:00:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 10:00:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:00:31 [WARNING ] (13, 1, 'bot')
2019-01-21 10:00:31 [WARNING ] (13, 1, 'bot')
2019-01-21 10:00:31 [WARNING ] (13, 1, 'bot')
2019-01-21 10:00:31 [WARNING ] (13, 1, 'bot')
2019-01-21 10:00:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:00:31 [DEBUG   ] Finished updating board flags in 1.480 seconds
2019-01-21 10:00:49 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 10:01:06 [DEBUG   ] Got command RPT from MCS: ref #1237251
2019-01-21 10:01:06 [DEBUG   ] summary = ERROR
2019-01-21 10:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237251  13 58504 36066941 A  ERRORERROR'
2019-01-21 10:01:06 [DEBUG   ] Got command RPT from MCS: ref #1237252
2019-01-21 10:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237252  77 58504 36066942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:01:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 10:01:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 10:01:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:01:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 10:01:31 [WARNING ] (13, 1, 'bot')
2019-01-21 10:01:31 [WARNING ] (13, 1, 'bot')
2019-01-21 10:01:31 [WARNING ] (13, 1, 'bot')
2019-01-21 10:01:31 [WARNING ] (13, 1, 'bot')
2019-01-21 10:01:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:01:31 [DEBUG   ] Finished updating board flags in 1.478 seconds
2019-01-21 10:01:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 10:02:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 10:02:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 10:02:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:02:31 [WARNING ] (13, 1, 'bot')
2019-01-21 10:02:31 [WARNING ] (13, 1, 'bot')
2019-01-21 10:02:31 [WARNING ] (13, 1, 'bot')
2019-01-21 10:02:31 [WARNING ] (13, 1, 'bot')
2019-01-21 10:02:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:02:31 [DEBUG   ] Finished updating board flags in 1.490 seconds
2019-01-21 10:02:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 10:03:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 10:03:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 10:03:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:03:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:03:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:03:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:03:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:03:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:03:32 [DEBUG   ] Finished updating board flags in 2.188 seconds
2019-01-21 10:03:41 [DEBUG   ] Got command RPT from MCS: ref #1237272
2019-01-21 10:03:41 [DEBUG   ] summary = ERROR
2019-01-21 10:03:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237272  13 58504 36221885 A  ERRORERROR'
2019-01-21 10:03:42 [DEBUG   ] Got command RPT from MCS: ref #1237273
2019-01-21 10:03:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:03:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237273  77 58504 36222077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:03:42 [DEBUG   ] Got command RPT from MCS: ref #1237274
2019-01-21 10:03:42 [DEBUG   ] summary = ERROR
2019-01-21 10:03:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237274  13 58504 36222281 A  ERRORERROR'
2019-01-21 10:03:42 [DEBUG   ] Got command RPT from MCS: ref #1237275
2019-01-21 10:03:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:03:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237275  77 58504 36222485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:03:42 [DEBUG   ] Got command RPT from MCS: ref #1237276
2019-01-21 10:03:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 10:03:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237276  12 58504 36222689 A  ERRORB–™š'
2019-01-21 10:03:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:04:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:04:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:04:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:04:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:04:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:04:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:04:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:04:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:04:32 [DEBUG   ] Finished updating board flags in 1.975 seconds
2019-01-21 10:04:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:05:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 10:05:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:05:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:05:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:05:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:05:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:05:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:05:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:05:32 [DEBUG   ] Finished updating board flags in 1.829 seconds
2019-01-21 10:05:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 10:06:06 [DEBUG   ] Got command RPT from MCS: ref #1237281
2019-01-21 10:06:06 [DEBUG   ] summary = ERROR
2019-01-21 10:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237281  13 58504 36366949 A  ERRORERROR'
2019-01-21 10:06:06 [DEBUG   ] Got command RPT from MCS: ref #1237282
2019-01-21 10:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237282  77 58504 36366950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:06:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 10:06:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 10:06:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:06:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:06:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:06:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:06:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:06:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:06:32 [DEBUG   ] Finished updating board flags in 1.777 seconds
2019-01-21 10:06:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 10:07:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 10:07:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 10:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:07:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:07:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:07:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:07:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:07:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:07:32 [DEBUG   ] Finished updating board flags in 1.638 seconds
2019-01-21 10:07:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 10:08:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 10:08:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 10:08:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:08:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:08:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:08:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:08:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:08:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:08:32 [DEBUG   ] Finished updating board flags in 1.674 seconds
2019-01-21 10:08:41 [DEBUG   ] Got command RPT from MCS: ref #1237304
2019-01-21 10:08:41 [DEBUG   ] summary = ERROR
2019-01-21 10:08:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237304  13 58504 36521965 A  ERRORERROR'
2019-01-21 10:08:42 [DEBUG   ] Got command RPT from MCS: ref #1237305
2019-01-21 10:08:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:08:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237305  77 58504 36522169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:08:42 [DEBUG   ] Got command RPT from MCS: ref #1237306
2019-01-21 10:08:42 [DEBUG   ] summary = ERROR
2019-01-21 10:08:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237306  13 58504 36522361 A  ERRORERROR'
2019-01-21 10:08:42 [DEBUG   ] Got command RPT from MCS: ref #1237308
2019-01-21 10:08:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:08:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237308  77 58504 36522565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:08:42 [DEBUG   ] Got command RPT from MCS: ref #1237310
2019-01-21 10:08:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 10:08:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237310  12 58504 36522769 A  ERRORB–™š'
2019-01-21 10:08:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 10:09:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 10:09:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 10:09:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:09:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:09:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:09:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:09:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:09:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:09:32 [DEBUG   ] Finished updating board flags in 1.503 seconds
2019-01-21 10:09:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 10:10:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 10:10:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 10:10:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 10:10:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:10:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:10:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:10:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:10:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:10:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:10:32 [DEBUG   ] Finished updating board flags in 1.474 seconds
2019-01-21 10:10:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 10:11:06 [DEBUG   ] Got command RPT from MCS: ref #1237318
2019-01-21 10:11:06 [DEBUG   ] summary = ERROR
2019-01-21 10:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237318  13 58504 36666941 A  ERRORERROR'
2019-01-21 10:11:06 [DEBUG   ] Got command RPT from MCS: ref #1237319
2019-01-21 10:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237319  77 58504 36666942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:11:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 10:11:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 10:11:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 10:11:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:11:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 10:11:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:11:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:11:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:11:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:11:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:11:32 [DEBUG   ] Finished updating board flags in 1.480 seconds
2019-01-21 10:11:50 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 10:12:10 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 10:12:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 10:12:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:12:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:12:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:12:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:12:32 [WARNING ] (13, 1, 'bot')
2019-01-21 10:12:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:12:32 [DEBUG   ] Finished updating board flags in 1.480 seconds
2019-01-21 10:12:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 10:13:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 10:13:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 10:13:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:13:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:13:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:13:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:13:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:13:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:13:33 [DEBUG   ] Finished updating board flags in 2.196 seconds
2019-01-21 10:13:42 [DEBUG   ] Got command RPT from MCS: ref #1237335
2019-01-21 10:13:42 [DEBUG   ] summary = ERROR
2019-01-21 10:13:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237335  13 58504 36822053 A  ERRORERROR'
2019-01-21 10:13:42 [DEBUG   ] Got command RPT from MCS: ref #1237336
2019-01-21 10:13:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:13:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237336  77 58504 36822245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:13:42 [DEBUG   ] Got command RPT from MCS: ref #1237337
2019-01-21 10:13:42 [DEBUG   ] summary = ERROR
2019-01-21 10:13:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237337  13 58504 36822449 A  ERRORERROR'
2019-01-21 10:13:42 [DEBUG   ] Got command RPT from MCS: ref #1237338
2019-01-21 10:13:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:13:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237338  77 58504 36822653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:13:42 [DEBUG   ] Got command RPT from MCS: ref #1237339
2019-01-21 10:13:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 10:13:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237339  12 58504 36822857 A  ERRORB˜™š'
2019-01-21 10:13:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 10:14:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 10:14:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 10:14:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:14:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:14:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:14:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:14:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:14:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:14:33 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-21 10:14:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-21 10:15:10 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2019-01-21 10:15:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 10:15:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:15:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:15:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:15:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:15:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:15:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:15:33 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-21 10:15:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 10:16:06 [DEBUG   ] Got command RPT from MCS: ref #1237344
2019-01-21 10:16:06 [DEBUG   ] summary = ERROR
2019-01-21 10:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237344  13 58504 36966941 A  ERRORERROR'
2019-01-21 10:16:06 [DEBUG   ] Got command RPT from MCS: ref #1237345
2019-01-21 10:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237345  77 58504 36966942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:16:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 10:16:30 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-21 10:16:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:16:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 10:16:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:16:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:16:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:16:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:16:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:16:33 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-01-21 10:16:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:17:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 10:17:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 10:17:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:17:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:17:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:17:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:17:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:17:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:17:33 [DEBUG   ] Finished updating board flags in 1.637 seconds
2019-01-21 10:17:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 10:18:11 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-21 10:18:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 10:18:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:18:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:18:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:18:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:18:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:18:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:18:33 [DEBUG   ] Finished updating board flags in 1.542 seconds
2019-01-21 10:18:42 [DEBUG   ] Got command RPT from MCS: ref #1237367
2019-01-21 10:18:42 [DEBUG   ] summary = ERROR
2019-01-21 10:18:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237367  13 58504 37122129 A  ERRORERROR'
2019-01-21 10:18:42 [DEBUG   ] Got command RPT from MCS: ref #1237368
2019-01-21 10:18:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:18:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237368  77 58504 37122333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:18:42 [DEBUG   ] Got command RPT from MCS: ref #1237369
2019-01-21 10:18:42 [DEBUG   ] summary = ERROR
2019-01-21 10:18:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237369  13 58504 37122537 A  ERRORERROR'
2019-01-21 10:18:42 [DEBUG   ] Got command RPT from MCS: ref #1237371
2019-01-21 10:18:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:18:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237371  77 58504 37122729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:18:42 [DEBUG   ] Got command RPT from MCS: ref #1237372
2019-01-21 10:18:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 10:18:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237372  12 58504 37122933 A  ERRORB–™š'
2019-01-21 10:18:51 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-21 10:19:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 10:19:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 10:19:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:19:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:19:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:19:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:19:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:19:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:19:33 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-21 10:19:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:20:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:20:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:20:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:20:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:20:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:20:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:20:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:20:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:20:33 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-21 10:20:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 10:21:06 [DEBUG   ] Got command RPT from MCS: ref #1237381
2019-01-21 10:21:06 [DEBUG   ] summary = ERROR
2019-01-21 10:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237381  13 58504 37266942 A  ERRORERROR'
2019-01-21 10:21:06 [DEBUG   ] Got command RPT from MCS: ref #1237382
2019-01-21 10:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237382  77 58504 37266942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:21:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:21:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:21:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:21:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:21:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:21:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:21:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:21:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:21:33 [DEBUG   ] Finished updating board flags in 1.498 seconds
2019-01-21 10:21:51 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-21 10:22:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 10:22:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 10:22:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:22:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 10:22:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:22:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:22:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:22:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:22:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:22:33 [DEBUG   ] Finished updating board flags in 1.481 seconds
2019-01-21 10:22:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 10:23:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 10:23:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 10:23:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:23:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:23:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:23:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:23:33 [WARNING ] (13, 1, 'bot')
2019-01-21 10:23:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:23:33 [DEBUG   ] Finished updating board flags in 1.489 seconds
2019-01-21 10:23:42 [DEBUG   ] Got command RPT from MCS: ref #1237402
2019-01-21 10:23:42 [DEBUG   ] summary = ERROR
2019-01-21 10:23:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237402  13 58504 37422225 A  ERRORERROR'
2019-01-21 10:23:42 [DEBUG   ] Got command RPT from MCS: ref #1237403
2019-01-21 10:23:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:23:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237403  77 58504 37422417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:23:42 [DEBUG   ] Got command RPT from MCS: ref #1237404
2019-01-21 10:23:42 [DEBUG   ] summary = ERROR
2019-01-21 10:23:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237404  13 58504 37422621 A  ERRORERROR'
2019-01-21 10:23:42 [DEBUG   ] Got command RPT from MCS: ref #1237405
2019-01-21 10:23:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:23:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237405  77 58504 37422825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:23:43 [DEBUG   ] Got command RPT from MCS: ref #1237406
2019-01-21 10:23:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 10:23:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237406  12 58504 37423017 A  ERRORB•™š'
2019-01-21 10:23:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 10:24:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:24:32 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2019-01-21 10:24:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:24:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 10:24:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:24:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:24:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:24:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:24:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:24:34 [DEBUG   ] Finished updating board flags in 2.245 seconds
2019-01-21 10:24:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 10:25:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:25:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:25:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:25:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:25:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:25:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:25:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:25:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:25:34 [DEBUG   ] Finished updating board flags in 2.082 seconds
2019-01-21 10:25:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:26:06 [DEBUG   ] Got command RPT from MCS: ref #1237411
2019-01-21 10:26:06 [DEBUG   ] summary = ERROR
2019-01-21 10:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237411  13 58504 37566945 A  ERRORERROR'
2019-01-21 10:26:06 [DEBUG   ] Got command RPT from MCS: ref #1237412
2019-01-21 10:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237412  77 58504 37566946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:26:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 10:26:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 10:26:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:26:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:26:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:26:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:26:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:26:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:26:34 [DEBUG   ] Finished updating board flags in 2.034 seconds
2019-01-21 10:26:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 10:27:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:27:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 10:27:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:27:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:27:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:27:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:27:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:27:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:27:34 [DEBUG   ] Finished updating board flags in 1.977 seconds
2019-01-21 10:27:51 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 10:28:12 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 10:28:32 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 10:28:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-21 10:28:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:28:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:28:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:28:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:28:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:28:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:28:34 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-01-21 10:28:42 [DEBUG   ] Got command RPT from MCS: ref #1237430
2019-01-21 10:28:42 [DEBUG   ] summary = ERROR
2019-01-21 10:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237430  13 58504 37722309 A  ERRORERROR'
2019-01-21 10:28:42 [DEBUG   ] Got command RPT from MCS: ref #1237431
2019-01-21 10:28:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237431  77 58504 37722513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:28:42 [DEBUG   ] Got command RPT from MCS: ref #1237432
2019-01-21 10:28:42 [DEBUG   ] summary = ERROR
2019-01-21 10:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237432  13 58504 37722705 A  ERRORERROR'
2019-01-21 10:28:42 [DEBUG   ] Got command RPT from MCS: ref #1237434
2019-01-21 10:28:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237434  77 58504 37722909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:28:43 [DEBUG   ] Got command RPT from MCS: ref #1237436
2019-01-21 10:28:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 10:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237436  12 58504 37723113 A  ERRORB—™š'
2019-01-21 10:28:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 10:29:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 10:29:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 10:29:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:29:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:29:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:29:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:29:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:29:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:29:34 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-01-21 10:29:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 10:30:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 10:30:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 10:30:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:30:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:30:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:30:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:30:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:30:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:30:34 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-01-21 10:30:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:31:06 [DEBUG   ] Got command RPT from MCS: ref #1237444
2019-01-21 10:31:06 [DEBUG   ] summary = ERROR
2019-01-21 10:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237444  13 58504 37866953 A  ERRORERROR'
2019-01-21 10:31:06 [DEBUG   ] Got command RPT from MCS: ref #1237445
2019-01-21 10:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237445  77 58504 37866954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:31:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:31:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:31:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:31:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:31:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:31:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:31:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:31:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:31:34 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-01-21 10:31:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:32:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 10:32:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:32:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:32:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 10:32:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:32:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:32:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:32:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:32:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:32:34 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-01-21 10:32:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:33:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:33:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:33:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:33:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 10:33:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:33:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:33:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:33:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:33:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:33:34 [DEBUG   ] Finished updating board flags in 1.561 seconds
2019-01-21 10:33:42 [DEBUG   ] Got command RPT from MCS: ref #1237465
2019-01-21 10:33:42 [DEBUG   ] summary = ERROR
2019-01-21 10:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237465  13 58504 38022393 A  ERRORERROR'
2019-01-21 10:33:42 [DEBUG   ] Got command RPT from MCS: ref #1237466
2019-01-21 10:33:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237466  77 58504 38022597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:33:42 [DEBUG   ] Got command RPT from MCS: ref #1237467
2019-01-21 10:33:42 [DEBUG   ] summary = ERROR
2019-01-21 10:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237467  13 58504 38022801 A  ERRORERROR'
2019-01-21 10:33:42 [DEBUG   ] Got command RPT from MCS: ref #1237468
2019-01-21 10:33:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237468  77 58504 38022993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:33:43 [DEBUG   ] Got command RPT from MCS: ref #1237469
2019-01-21 10:33:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 10:33:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237469  12 58504 38023197 A  ERRORB—™š'
2019-01-21 10:33:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:34:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:34:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:34:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:34:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 10:34:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:34:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:34:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:34:34 [WARNING ] (13, 1, 'bot')
2019-01-21 10:34:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:34:34 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-21 10:34:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:35:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:35:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:35:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:35:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:35:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:35:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:35:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:35:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:35:35 [DEBUG   ] Finished updating board flags in 2.176 seconds
2019-01-21 10:35:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:36:06 [DEBUG   ] Got command RPT from MCS: ref #1237474
2019-01-21 10:36:06 [DEBUG   ] summary = ERROR
2019-01-21 10:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237474  13 58504 38166949 A  ERRORERROR'
2019-01-21 10:36:06 [DEBUG   ] Got command RPT from MCS: ref #1237475
2019-01-21 10:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237475  77 58504 38166950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:36:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:36:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:36:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:36:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:36:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:36:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:36:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:36:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:36:35 [DEBUG   ] Finished updating board flags in 1.889 seconds
2019-01-21 10:36:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:37:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 10:37:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:37:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:37:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:37:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:37:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:37:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:37:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:37:35 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-21 10:37:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:38:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:38:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 10:38:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:38:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:38:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:38:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:38:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:38:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:38:35 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-21 10:38:42 [DEBUG   ] Got command RPT from MCS: ref #1237497
2019-01-21 10:38:42 [DEBUG   ] summary = ERROR
2019-01-21 10:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237497  13 58504 38322473 A  ERRORERROR'
2019-01-21 10:38:42 [DEBUG   ] Got command RPT from MCS: ref #1237498
2019-01-21 10:38:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237498  77 58504 38322677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:38:42 [DEBUG   ] Got command RPT from MCS: ref #1237499
2019-01-21 10:38:42 [DEBUG   ] summary = ERROR
2019-01-21 10:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237499  13 58504 38322881 A  ERRORERROR'
2019-01-21 10:38:43 [DEBUG   ] Got command RPT from MCS: ref #1237501
2019-01-21 10:38:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237501  77 58504 38323085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:38:43 [DEBUG   ] Got command RPT from MCS: ref #1237502
2019-01-21 10:38:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 10:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237502  12 58504 38323277 A  ERRORB•™š'
2019-01-21 10:38:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:39:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:39:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:39:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:39:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 10:39:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:39:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:39:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:39:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:39:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:39:35 [DEBUG   ] Finished updating board flags in 1.769 seconds
2019-01-21 10:39:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 10:40:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:40:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 10:40:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:40:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:40:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:40:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:40:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:40:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:40:35 [DEBUG   ] Finished updating board flags in 1.671 seconds
2019-01-21 10:40:52 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 10:41:06 [DEBUG   ] Got command RPT from MCS: ref #1237511
2019-01-21 10:41:06 [DEBUG   ] summary = ERROR
2019-01-21 10:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237511  13 58504 38466949 A  ERRORERROR'
2019-01-21 10:41:06 [DEBUG   ] Got command RPT from MCS: ref #1237512
2019-01-21 10:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237512  77 58504 38466950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:41:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 10:41:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 10:41:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:41:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:41:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:41:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:41:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:41:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:41:35 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-21 10:41:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 10:42:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 10:42:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 10:42:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:42:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:42:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:42:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:42:35 [WARNING ] (13, 1, 'bot')
2019-01-21 10:42:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:42:35 [DEBUG   ] Finished updating board flags in 1.559 seconds
2019-01-21 10:42:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 10:43:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 10:43:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 10:43:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:43:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:43:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:43:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:43:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:43:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:43:36 [DEBUG   ] Finished updating board flags in 2.286 seconds
2019-01-21 10:43:42 [DEBUG   ] Got command RPT from MCS: ref #1237528
2019-01-21 10:43:42 [DEBUG   ] summary = ERROR
2019-01-21 10:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237528  13 58504 38622561 A  ERRORERROR'
2019-01-21 10:43:42 [DEBUG   ] Got command RPT from MCS: ref #1237529
2019-01-21 10:43:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237529  77 58504 38622765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:43:42 [DEBUG   ] Got command RPT from MCS: ref #1237530
2019-01-21 10:43:42 [DEBUG   ] summary = ERROR
2019-01-21 10:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237530  13 58504 38622969 A  ERRORERROR'
2019-01-21 10:43:43 [DEBUG   ] Got command RPT from MCS: ref #1237531
2019-01-21 10:43:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:43:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237531  77 58504 38623173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:43:43 [DEBUG   ] Got command RPT from MCS: ref #1237532
2019-01-21 10:43:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 10:43:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237532  12 58504 38623365 A  ERRORB—™š'
2019-01-21 10:43:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:44:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 10:44:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 10:44:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:44:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:44:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:44:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:44:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:44:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:44:36 [DEBUG   ] Finished updating board flags in 2.211 seconds
2019-01-21 10:44:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 10:45:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 10:45:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:45:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:45:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:45:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:45:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:45:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:45:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:45:36 [DEBUG   ] Finished updating board flags in 2.100 seconds
2019-01-21 10:45:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 10:46:06 [DEBUG   ] Got command RPT from MCS: ref #1237537
2019-01-21 10:46:06 [DEBUG   ] summary = ERROR
2019-01-21 10:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237537  13 58504 38766953 A  ERRORERROR'
2019-01-21 10:46:06 [DEBUG   ] Got command RPT from MCS: ref #1237538
2019-01-21 10:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237538  77 58504 38766954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:46:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:46:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:46:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-21 10:46:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:46:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:46:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:46:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:46:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:46:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:46:36 [DEBUG   ] Finished updating board flags in 2.035 seconds
2019-01-21 10:46:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:47:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 10:47:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 10:47:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:47:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:47:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:47:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:47:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:47:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:47:36 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-01-21 10:47:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 10:48:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:48:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 10:48:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:48:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:48:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:48:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:48:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:48:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:48:36 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-21 10:48:42 [DEBUG   ] Got command RPT from MCS: ref #1237560
2019-01-21 10:48:42 [DEBUG   ] summary = ERROR
2019-01-21 10:48:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237560  13 58504 38922649 A  ERRORERROR'
2019-01-21 10:48:42 [DEBUG   ] Got command RPT from MCS: ref #1237561
2019-01-21 10:48:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:48:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237561  77 58504 38922853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:48:43 [DEBUG   ] Got command RPT from MCS: ref #1237562
2019-01-21 10:48:43 [DEBUG   ] summary = ERROR
2019-01-21 10:48:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237562  13 58504 38923057 A  ERRORERROR'
2019-01-21 10:48:43 [DEBUG   ] Got command RPT from MCS: ref #1237564
2019-01-21 10:48:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:48:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237564  77 58504 38923250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:48:43 [DEBUG   ] Got command RPT from MCS: ref #1237565
2019-01-21 10:48:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 10:48:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237565  12 58504 38923453 A  ERRORB—™š'
2019-01-21 10:48:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:49:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:49:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:49:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:49:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:49:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:49:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:49:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:49:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:49:36 [DEBUG   ] Finished updating board flags in 1.849 seconds
2019-01-21 10:49:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 10:50:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 10:50:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:50:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:50:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:50:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:50:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:50:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:50:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:50:36 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-01-21 10:50:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 10:51:06 [DEBUG   ] Got command RPT from MCS: ref #1237574
2019-01-21 10:51:06 [DEBUG   ] summary = ERROR
2019-01-21 10:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237574  13 58504 39066950 A  ERRORERROR'
2019-01-21 10:51:06 [DEBUG   ] Got command RPT from MCS: ref #1237575
2019-01-21 10:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237575  77 58504 39066950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:51:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 10:51:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:51:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:51:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:51:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:51:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:51:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:51:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:51:36 [DEBUG   ] Finished updating board flags in 1.695 seconds
2019-01-21 10:51:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 10:52:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 10:52:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 10:52:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:52:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:52:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:52:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:52:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:52:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:52:36 [DEBUG   ] Finished updating board flags in 1.625 seconds
2019-01-21 10:52:52 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 10:53:12 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-21 10:53:32 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-21 10:53:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:53:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:53:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:53:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:53:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:53:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:53:36 [DEBUG   ] Finished updating board flags in 1.579 seconds
2019-01-21 10:53:42 [DEBUG   ] Got command RPT from MCS: ref #1237595
2019-01-21 10:53:42 [DEBUG   ] summary = ERROR
2019-01-21 10:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237595  13 58504 39222733 A  ERRORERROR'
2019-01-21 10:53:42 [DEBUG   ] Got command RPT from MCS: ref #1237596
2019-01-21 10:53:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237596  77 58504 39222937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:53:43 [DEBUG   ] Got command RPT from MCS: ref #1237597
2019-01-21 10:53:43 [DEBUG   ] summary = ERROR
2019-01-21 10:53:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237597  13 58504 39223141 A  ERRORERROR'
2019-01-21 10:53:43 [DEBUG   ] Got command RPT from MCS: ref #1237598
2019-01-21 10:53:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:53:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237598  77 58504 39223345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:53:43 [DEBUG   ] Got command RPT from MCS: ref #1237599
2019-01-21 10:53:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 10:53:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237599  12 58504 39223537 A  ERRORB–™š'
2019-01-21 10:53:53 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 10:54:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 10:54:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 10:54:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:54:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:54:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:54:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:54:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:54:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:54:36 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-21 10:54:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 10:55:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 10:55:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 10:55:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:55:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:55:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:55:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:55:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:55:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:55:36 [DEBUG   ] Finished updating board flags in 1.472 seconds
2019-01-21 10:55:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 10:56:06 [DEBUG   ] Got command RPT from MCS: ref #1237604
2019-01-21 10:56:06 [DEBUG   ] summary = ERROR
2019-01-21 10:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237604  13 58504 39366949 A  ERRORERROR'
2019-01-21 10:56:06 [DEBUG   ] Got command RPT from MCS: ref #1237605
2019-01-21 10:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237605  77 58504 39366950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:56:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 10:56:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 10:56:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:56:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:56:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:56:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:56:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:56:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:56:36 [DEBUG   ] Finished updating board flags in 1.480 seconds
2019-01-21 10:56:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:57:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:57:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 10:57:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:57:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:57:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:57:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:57:36 [WARNING ] (13, 1, 'bot')
2019-01-21 10:57:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:57:36 [DEBUG   ] Finished updating board flags in 1.482 seconds
2019-01-21 10:57:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:58:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 10:58:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 10:58:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:58:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 10:58:37 [WARNING ] (13, 1, 'bot')
2019-01-21 10:58:37 [WARNING ] (13, 1, 'bot')
2019-01-21 10:58:37 [WARNING ] (13, 1, 'bot')
2019-01-21 10:58:37 [WARNING ] (13, 1, 'bot')
2019-01-21 10:58:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:58:37 [DEBUG   ] Finished updating board flags in 2.184 seconds
2019-01-21 10:58:42 [DEBUG   ] Got command RPT from MCS: ref #1237623
2019-01-21 10:58:42 [DEBUG   ] summary = ERROR
2019-01-21 10:58:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237623  13 58504 39522821 A  ERRORERROR'
2019-01-21 10:58:43 [DEBUG   ] Got command RPT from MCS: ref #1237624
2019-01-21 10:58:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237624  77 58504 39523025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:58:43 [DEBUG   ] Got command RPT from MCS: ref #1237625
2019-01-21 10:58:43 [DEBUG   ] summary = ERROR
2019-01-21 10:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237625  13 58504 39523217 A  ERRORERROR'
2019-01-21 10:58:43 [DEBUG   ] Got command RPT from MCS: ref #1237627
2019-01-21 10:58:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 10:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237627  77 58504 39523421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 10:58:43 [DEBUG   ] Got command RPT from MCS: ref #1237629
2019-01-21 10:58:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 10:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237629  12 58504 39523625 A  ERRORB•™š'
2019-01-21 10:58:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 10:59:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 10:59:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 10:59:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 10:59:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 10:59:37 [WARNING ] (13, 1, 'bot')
2019-01-21 10:59:37 [WARNING ] (13, 1, 'bot')
2019-01-21 10:59:37 [WARNING ] (13, 1, 'bot')
2019-01-21 10:59:37 [WARNING ] (13, 1, 'bot')
2019-01-21 10:59:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 10:59:37 [DEBUG   ] Finished updating board flags in 2.100 seconds
2019-01-21 10:59:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 11:00:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 11:00:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:00:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:00:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-21 11:00:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:00:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:00:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:00:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:00:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:00:37 [DEBUG   ] Finished updating board flags in 1.875 seconds
2019-01-21 11:00:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:01:06 [DEBUG   ] Got command RPT from MCS: ref #1237637
2019-01-21 11:01:06 [DEBUG   ] summary = ERROR
2019-01-21 11:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237637  13 58504 39666957 A  ERRORERROR'
2019-01-21 11:01:06 [DEBUG   ] Got command RPT from MCS: ref #1237638
2019-01-21 11:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237638  77 58504 39666958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:01:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:01:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 11:01:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 11:01:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:01:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:01:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:01:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:01:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:01:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:01:37 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-21 11:01:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:02:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:02:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:02:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:02:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:02:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:02:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:02:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:02:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:02:37 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-21 11:02:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:03:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:03:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:03:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:03:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:03:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:03:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:03:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:03:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:03:37 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-01-21 11:03:42 [DEBUG   ] Got command RPT from MCS: ref #1237658
2019-01-21 11:03:42 [DEBUG   ] summary = ERROR
2019-01-21 11:03:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237658  13 58504 39822909 A  ERRORERROR'
2019-01-21 11:03:43 [DEBUG   ] Got command RPT from MCS: ref #1237659
2019-01-21 11:03:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:03:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237659  77 58504 39823113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:03:43 [DEBUG   ] Got command RPT from MCS: ref #1237660
2019-01-21 11:03:43 [DEBUG   ] summary = ERROR
2019-01-21 11:03:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237660  13 58504 39823305 A  ERRORERROR'
2019-01-21 11:03:43 [DEBUG   ] Got command RPT from MCS: ref #1237661
2019-01-21 11:03:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:03:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237661  77 58504 39823509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:03:43 [DEBUG   ] Got command RPT from MCS: ref #1237662
2019-01-21 11:03:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 11:03:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237662  12 58504 39823713 A  ERRORB˜™š'
2019-01-21 11:03:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:04:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:04:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:04:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:04:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:04:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:04:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:04:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:04:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:04:37 [DEBUG   ] Finished updating board flags in 1.713 seconds
2019-01-21 11:04:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:05:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:05:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 11:05:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:05:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:05:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:05:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:05:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:05:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:05:37 [DEBUG   ] Finished updating board flags in 1.523 seconds
2019-01-21 11:05:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:06:06 [DEBUG   ] Got command RPT from MCS: ref #1237667
2019-01-21 11:06:06 [DEBUG   ] summary = ERROR
2019-01-21 11:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237667  13 58504 39966957 A  ERRORERROR'
2019-01-21 11:06:06 [DEBUG   ] Got command RPT from MCS: ref #1237668
2019-01-21 11:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237668  77 58504 39966958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:06:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 11:06:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:06:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:06:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:06:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:06:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:06:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:06:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:06:37 [DEBUG   ] Finished updating board flags in 1.522 seconds
2019-01-21 11:06:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 11:07:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:07:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:07:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:07:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:07:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:07:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:07:37 [WARNING ] (13, 1, 'bot')
2019-01-21 11:07:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:07:37 [DEBUG   ] Finished updating board flags in 1.522 seconds
2019-01-21 11:07:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:08:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 11:08:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:08:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:08:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:08:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:08:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:08:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:08:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:08:38 [DEBUG   ] Finished updating board flags in 2.182 seconds
2019-01-21 11:08:42 [DEBUG   ] Got command RPT from MCS: ref #1237690
2019-01-21 11:08:42 [DEBUG   ] summary = ERROR
2019-01-21 11:08:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237690  13 58504 40122989 A  ERRORERROR'
2019-01-21 11:08:43 [DEBUG   ] Got command RPT from MCS: ref #1237691
2019-01-21 11:08:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237691  77 58504 40123193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:08:43 [DEBUG   ] Got command RPT from MCS: ref #1237692
2019-01-21 11:08:43 [DEBUG   ] summary = ERROR
2019-01-21 11:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237692  13 58504 40123397 A  ERRORERROR'
2019-01-21 11:08:43 [DEBUG   ] Got command RPT from MCS: ref #1237694
2019-01-21 11:08:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237694  77 58504 40123589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:08:43 [DEBUG   ] Got command RPT from MCS: ref #1237696
2019-01-21 11:08:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 11:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237696  12 58504 40123793 A  ERRORB–™š'
2019-01-21 11:08:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:09:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:09:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 11:09:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:09:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:09:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:09:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:09:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:09:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:09:38 [DEBUG   ] Finished updating board flags in 2.060 seconds
2019-01-21 11:09:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:10:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:10:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:10:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:10:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 11:10:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:10:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:10:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:10:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:10:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:10:38 [DEBUG   ] Finished updating board flags in 1.901 seconds
2019-01-21 11:10:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 11:11:06 [DEBUG   ] Got command RPT from MCS: ref #1237704
2019-01-21 11:11:06 [DEBUG   ] summary = ERROR
2019-01-21 11:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237704  13 58504 40266953 A  ERRORERROR'
2019-01-21 11:11:06 [DEBUG   ] Got command RPT from MCS: ref #1237705
2019-01-21 11:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237705  77 58504 40266954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:11:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 11:11:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 11:11:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:11:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:11:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:11:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:11:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:11:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:11:38 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-21 11:11:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 11:12:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 11:12:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 11:12:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:12:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:12:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:12:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:12:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:12:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:12:38 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-21 11:12:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 11:13:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 11:13:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 11:13:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:13:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:13:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:13:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:13:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:13:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:13:38 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-21 11:13:43 [DEBUG   ] Got command RPT from MCS: ref #1237721
2019-01-21 11:13:43 [DEBUG   ] summary = ERROR
2019-01-21 11:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237721  13 58504 40423085 A  ERRORERROR'
2019-01-21 11:13:43 [DEBUG   ] Got command RPT from MCS: ref #1237722
2019-01-21 11:13:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237722  77 58504 40423277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:13:43 [DEBUG   ] Got command RPT from MCS: ref #1237723
2019-01-21 11:13:43 [DEBUG   ] summary = ERROR
2019-01-21 11:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237723  13 58504 40423481 A  ERRORERROR'
2019-01-21 11:13:43 [DEBUG   ] Got command RPT from MCS: ref #1237724
2019-01-21 11:13:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237724  77 58504 40423685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:13:43 [DEBUG   ] Got command RPT from MCS: ref #1237725
2019-01-21 11:13:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 11:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237725  12 58504 40423877 A  ERRORB–™š'
2019-01-21 11:13:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 11:14:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 11:14:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 11:14:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:14:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-21 11:14:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:14:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:14:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:14:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:14:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:14:38 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-21 11:14:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 11:15:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 11:15:34 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 11:15:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:15:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:15:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:15:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:15:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:15:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:15:38 [DEBUG   ] Finished updating board flags in 1.455 seconds
2019-01-21 11:15:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-21 11:16:06 [DEBUG   ] Got command RPT from MCS: ref #1237730
2019-01-21 11:16:06 [DEBUG   ] summary = ERROR
2019-01-21 11:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237730  13 58504 40566957 A  ERRORERROR'
2019-01-21 11:16:06 [DEBUG   ] Got command RPT from MCS: ref #1237731
2019-01-21 11:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237731  77 58504 40566958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:16:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 11:16:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 11:16:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-21 11:16:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:16:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:16:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:16:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:16:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:16:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:16:38 [DEBUG   ] Finished updating board flags in 1.455 seconds
2019-01-21 11:16:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 11:17:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 11:17:34 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-21 11:17:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:17:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:17:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:17:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:17:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:17:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:17:38 [DEBUG   ] Finished updating board flags in 1.500 seconds
2019-01-21 11:17:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:18:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 11:18:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 11:18:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:18:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:18:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:18:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:18:38 [WARNING ] (13, 1, 'bot')
2019-01-21 11:18:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:18:38 [DEBUG   ] Finished updating board flags in 1.494 seconds
2019-01-21 11:18:43 [DEBUG   ] Got command RPT from MCS: ref #1237753
2019-01-21 11:18:43 [DEBUG   ] summary = ERROR
2019-01-21 11:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237753  13 58504 40723165 A  ERRORERROR'
2019-01-21 11:18:43 [DEBUG   ] Got command RPT from MCS: ref #1237754
2019-01-21 11:18:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237754  77 58504 40723369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:18:43 [DEBUG   ] Got command RPT from MCS: ref #1237755
2019-01-21 11:18:43 [DEBUG   ] summary = ERROR
2019-01-21 11:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237755  13 58504 40723561 A  ERRORERROR'
2019-01-21 11:18:43 [DEBUG   ] Got command RPT from MCS: ref #1237757
2019-01-21 11:18:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237757  77 58504 40723765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:18:43 [DEBUG   ] Got command RPT from MCS: ref #1237758
2019-01-21 11:18:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 11:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237758  12 58504 40723969 A  ERRORB˜™š'
2019-01-21 11:18:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 11:19:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 11:19:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 11:19:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 11:19:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:19:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:19:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:19:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:19:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:19:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:19:39 [DEBUG   ] Finished updating board flags in 2.145 seconds
2019-01-21 11:19:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 11:20:14 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-21 11:20:35 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 11:20:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:20:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:20:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:20:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:20:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:20:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:20:39 [DEBUG   ] Finished updating board flags in 1.963 seconds
2019-01-21 11:20:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 11:21:06 [DEBUG   ] Got command RPT from MCS: ref #1237767
2019-01-21 11:21:06 [DEBUG   ] summary = ERROR
2019-01-21 11:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237767  13 58504 40866961 A  ERRORERROR'
2019-01-21 11:21:06 [DEBUG   ] Got command RPT from MCS: ref #1237768
2019-01-21 11:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237768  77 58504 40866962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:21:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 11:21:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 11:21:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:21:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:21:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:21:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:21:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:21:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:21:39 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-21 11:21:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 11:22:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 11:22:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 11:22:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:22:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:22:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:22:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:22:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:22:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:22:39 [DEBUG   ] Finished updating board flags in 1.880 seconds
2019-01-21 11:22:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 11:23:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 11:23:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 11:23:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:23:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:23:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:23:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:23:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:23:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:23:39 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-21 11:23:43 [DEBUG   ] Got command RPT from MCS: ref #1237788
2019-01-21 11:23:43 [DEBUG   ] summary = ERROR
2019-01-21 11:23:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237788  13 58504 41023257 A  ERRORERROR'
2019-01-21 11:23:43 [DEBUG   ] Got command RPT from MCS: ref #1237789
2019-01-21 11:23:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:23:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237789  77 58504 41023449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:23:43 [DEBUG   ] Got command RPT from MCS: ref #1237790
2019-01-21 11:23:43 [DEBUG   ] summary = ERROR
2019-01-21 11:23:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237790  13 58504 41023653 A  ERRORERROR'
2019-01-21 11:23:43 [DEBUG   ] Got command RPT from MCS: ref #1237791
2019-01-21 11:23:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:23:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237791  77 58504 41023857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:23:44 [DEBUG   ] Got command RPT from MCS: ref #1237792
2019-01-21 11:23:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 11:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237792  12 58504 41024049 A  ERRORB–™š'
2019-01-21 11:23:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 11:24:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 11:24:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 11:24:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:24:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 11:24:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:24:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:24:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:24:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:24:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:24:39 [DEBUG   ] Finished updating board flags in 1.707 seconds
2019-01-21 11:24:55 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 11:25:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 11:25:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 11:25:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:25:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:25:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:25:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:25:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:25:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:25:39 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-21 11:25:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 11:26:06 [DEBUG   ] Got command RPT from MCS: ref #1237797
2019-01-21 11:26:06 [DEBUG   ] summary = ERROR
2019-01-21 11:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237797  13 58504 41166957 A  ERRORERROR'
2019-01-21 11:26:06 [DEBUG   ] Got command RPT from MCS: ref #1237798
2019-01-21 11:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237798  77 58504 41166958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:26:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 11:26:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 11:26:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:26:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 11:26:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:26:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:26:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:26:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:26:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:26:39 [DEBUG   ] Finished updating board flags in 1.578 seconds
2019-01-21 11:26:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:27:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 11:27:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:27:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:27:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:27:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:27:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:27:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:27:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:27:39 [DEBUG   ] Finished updating board flags in 1.466 seconds
2019-01-21 11:27:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 11:28:15 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-21 11:28:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 11:28:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 11:28:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:28:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:28:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:28:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:28:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:28:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:28:39 [DEBUG   ] Finished updating board flags in 1.466 seconds
2019-01-21 11:28:43 [DEBUG   ] Got command RPT from MCS: ref #1237816
2019-01-21 11:28:43 [DEBUG   ] summary = ERROR
2019-01-21 11:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237816  13 58504 41323341 A  ERRORERROR'
2019-01-21 11:28:43 [DEBUG   ] Got command RPT from MCS: ref #1237817
2019-01-21 11:28:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237817  77 58504 41323533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:28:43 [DEBUG   ] Got command RPT from MCS: ref #1237818
2019-01-21 11:28:43 [DEBUG   ] summary = ERROR
2019-01-21 11:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237818  13 58504 41323737 A  ERRORERROR'
2019-01-21 11:28:43 [DEBUG   ] Got command RPT from MCS: ref #1237820
2019-01-21 11:28:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237820  77 58504 41323941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:28:44 [DEBUG   ] Got command RPT from MCS: ref #1237821
2019-01-21 11:28:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 11:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237821  12 58504 41324133 A  ERRORB–™š'
2019-01-21 11:28:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 11:29:16 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 11:29:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 11:29:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:29:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:29:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:29:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:29:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:29:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:29:39 [DEBUG   ] Finished updating board flags in 1.463 seconds
2019-01-21 11:29:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 11:30:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 11:30:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 11:30:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:30:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:30:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:30:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:30:39 [WARNING ] (13, 1, 'bot')
2019-01-21 11:30:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:30:39 [DEBUG   ] Finished updating board flags in 1.476 seconds
2019-01-21 11:30:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 11:31:06 [DEBUG   ] Got command RPT from MCS: ref #1237830
2019-01-21 11:31:06 [DEBUG   ] summary = ERROR
2019-01-21 11:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237830  13 58504 41466961 A  ERRORERROR'
2019-01-21 11:31:06 [DEBUG   ] Got command RPT from MCS: ref #1237831
2019-01-21 11:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237831  77 58504 41466962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:31:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 11:31:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 11:31:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:31:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:31:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:31:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:31:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:31:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:31:40 [DEBUG   ] Finished updating board flags in 2.174 seconds
2019-01-21 11:31:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 11:32:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 11:32:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 11:32:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:32:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:32:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:32:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:32:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:32:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:32:40 [DEBUG   ] Finished updating board flags in 1.974 seconds
2019-01-21 11:32:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 11:33:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 11:33:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 11:33:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:33:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:33:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:33:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:33:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:33:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:33:40 [DEBUG   ] Finished updating board flags in 1.909 seconds
2019-01-21 11:33:43 [DEBUG   ] Got command RPT from MCS: ref #1237851
2019-01-21 11:33:43 [DEBUG   ] summary = ERROR
2019-01-21 11:33:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237851  13 58504 41623421 A  ERRORERROR'
2019-01-21 11:33:43 [DEBUG   ] Got command RPT from MCS: ref #1237852
2019-01-21 11:33:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:33:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237852  77 58504 41623625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:33:43 [DEBUG   ] Got command RPT from MCS: ref #1237853
2019-01-21 11:33:43 [DEBUG   ] summary = ERROR
2019-01-21 11:33:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237853  13 58504 41623829 A  ERRORERROR'
2019-01-21 11:33:44 [DEBUG   ] Got command RPT from MCS: ref #1237854
2019-01-21 11:33:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:33:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237854  77 58504 41624021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:33:44 [DEBUG   ] Got command RPT from MCS: ref #1237855
2019-01-21 11:33:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 11:33:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237855  12 58504 41624225 A  ERRORB˜™š'
2019-01-21 11:33:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 11:34:16 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-21 11:34:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:34:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:34:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:34:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:34:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:34:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:34:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:34:40 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-21 11:34:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:35:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:35:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:35:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:35:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:35:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:35:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:35:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:35:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:35:40 [DEBUG   ] Finished updating board flags in 1.699 seconds
2019-01-21 11:35:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 11:36:06 [DEBUG   ] Got command RPT from MCS: ref #1237860
2019-01-21 11:36:06 [DEBUG   ] summary = ERROR
2019-01-21 11:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237860  13 58504 41766961 A  ERRORERROR'
2019-01-21 11:36:06 [DEBUG   ] Got command RPT from MCS: ref #1237861
2019-01-21 11:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237861  77 58504 41766962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:36:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:36:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:36:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:36:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:36:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:36:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:36:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:36:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:36:40 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-01-21 11:36:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:37:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:37:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:37:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:37:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:37:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:37:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:37:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:37:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:37:40 [DEBUG   ] Finished updating board flags in 1.605 seconds
2019-01-21 11:37:56 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-21 11:38:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 11:38:37 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 11:38:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:38:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:38:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:38:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:38:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:38:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:38:40 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-21 11:38:43 [DEBUG   ] Got command RPT from MCS: ref #1237883
2019-01-21 11:38:43 [DEBUG   ] summary = ERROR
2019-01-21 11:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237883  13 58504 41923505 A  ERRORERROR'
2019-01-21 11:38:43 [DEBUG   ] Got command RPT from MCS: ref #1237884
2019-01-21 11:38:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237884  77 58504 41923709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:38:43 [DEBUG   ] Got command RPT from MCS: ref #1237885
2019-01-21 11:38:43 [DEBUG   ] summary = ERROR
2019-01-21 11:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237885  13 58504 41923913 A  ERRORERROR'
2019-01-21 11:38:44 [DEBUG   ] Got command RPT from MCS: ref #1237887
2019-01-21 11:38:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:38:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237887  77 58504 41924105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:38:44 [DEBUG   ] Got command RPT from MCS: ref #1237888
2019-01-21 11:38:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 11:38:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237888  12 58504 41924309 A  ERRORB–™š'
2019-01-21 11:38:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 11:39:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 11:39:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 11:39:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:39:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:39:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:39:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:39:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:39:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:39:40 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-21 11:39:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 11:40:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 11:40:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 11:40:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:40:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:40:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:40:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:40:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:40:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:40:40 [DEBUG   ] Finished updating board flags in 1.466 seconds
2019-01-21 11:40:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 11:41:06 [DEBUG   ] Got command RPT from MCS: ref #1237897
2019-01-21 11:41:06 [DEBUG   ] summary = ERROR
2019-01-21 11:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237897  13 58504 42066965 A  ERRORERROR'
2019-01-21 11:41:06 [DEBUG   ] Got command RPT from MCS: ref #1237898
2019-01-21 11:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237898  77 58504 42066966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:41:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 11:41:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 11:41:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:41:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:41:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:41:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:41:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:41:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:41:40 [DEBUG   ] Finished updating board flags in 1.516 seconds
2019-01-21 11:41:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 11:42:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 11:42:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 11:42:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:42:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:42:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:42:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:42:40 [WARNING ] (13, 1, 'bot')
2019-01-21 11:42:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:42:40 [DEBUG   ] Finished updating board flags in 1.559 seconds
2019-01-21 11:42:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 11:43:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 11:43:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 11:43:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:43:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 11:43:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:43:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:43:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:43:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:43:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:43:41 [DEBUG   ] Finished updating board flags in 2.162 seconds
2019-01-21 11:43:43 [DEBUG   ] Got command RPT from MCS: ref #1237914
2019-01-21 11:43:43 [DEBUG   ] summary = ERROR
2019-01-21 11:43:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237914  13 58504 42223597 A  ERRORERROR'
2019-01-21 11:43:43 [DEBUG   ] Got command RPT from MCS: ref #1237915
2019-01-21 11:43:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:43:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237915  77 58504 42223789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:43:43 [DEBUG   ] Got command RPT from MCS: ref #1237916
2019-01-21 11:43:43 [DEBUG   ] summary = ERROR
2019-01-21 11:43:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237916  13 58504 42223993 A  ERRORERROR'
2019-01-21 11:43:44 [DEBUG   ] Got command RPT from MCS: ref #1237917
2019-01-21 11:43:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:43:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237917  77 58504 42224197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:43:44 [DEBUG   ] Got command RPT from MCS: ref #1237918
2019-01-21 11:43:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 11:43:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237918  12 58504 42224401 A  ERRORB•™š'
2019-01-21 11:43:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 11:44:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-21 11:44:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 11:44:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:44:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:44:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:44:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:44:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:44:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:44:41 [DEBUG   ] Finished updating board flags in 1.890 seconds
2019-01-21 11:44:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:45:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:45:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:45:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:45:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 11:45:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:45:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:45:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:45:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:45:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:45:41 [DEBUG   ] Finished updating board flags in 1.846 seconds
2019-01-21 11:45:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 11:46:06 [DEBUG   ] Got command RPT from MCS: ref #1237923
2019-01-21 11:46:06 [DEBUG   ] summary = ERROR
2019-01-21 11:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237923  13 58504 42366969 A  ERRORERROR'
2019-01-21 11:46:06 [DEBUG   ] Got command RPT from MCS: ref #1237924
2019-01-21 11:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237924  77 58504 42366970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:46:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 11:46:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:46:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:46:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:46:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:46:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:46:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:46:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:46:41 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-21 11:46:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:47:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:47:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:47:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:47:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:47:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:47:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:47:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:47:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:47:41 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-21 11:47:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 11:48:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:48:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 11:48:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:48:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 11:48:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:48:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:48:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:48:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:48:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:48:41 [DEBUG   ] Finished updating board flags in 1.484 seconds
2019-01-21 11:48:43 [DEBUG   ] Got command RPT from MCS: ref #1237946
2019-01-21 11:48:43 [DEBUG   ] summary = ERROR
2019-01-21 11:48:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237946  13 58504 42523686 A  ERRORERROR'
2019-01-21 11:48:43 [DEBUG   ] Got command RPT from MCS: ref #1237947
2019-01-21 11:48:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:48:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237947  77 58504 42523877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:48:44 [DEBUG   ] Got command RPT from MCS: ref #1237948
2019-01-21 11:48:44 [DEBUG   ] summary = ERROR
2019-01-21 11:48:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237948  13 58504 42524081 A  ERRORERROR'
2019-01-21 11:48:44 [DEBUG   ] Got command RPT from MCS: ref #1237950
2019-01-21 11:48:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:48:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237950  77 58504 42524285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:48:44 [DEBUG   ] Got command RPT from MCS: ref #1237951
2019-01-21 11:48:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 11:48:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237951  12 58504 42524477 A  ERRORB—™š'
2019-01-21 11:48:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 11:49:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 11:49:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 11:49:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:49:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 11:49:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:49:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:49:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:49:41 [WARNING ] (13, 1, 'bot')
2019-01-21 11:49:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:49:41 [DEBUG   ] Finished updating board flags in 1.500 seconds
2019-01-21 11:49:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 11:50:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 11:50:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 11:50:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:50:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:50:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:50:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:50:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:50:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:50:42 [DEBUG   ] Finished updating board flags in 1.578 seconds
2019-01-21 11:50:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 11:51:06 [DEBUG   ] Got command RPT from MCS: ref #1237960
2019-01-21 11:51:06 [DEBUG   ] summary = ERROR
2019-01-21 11:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237960  13 58504 42666965 A  ERRORERROR'
2019-01-21 11:51:06 [DEBUG   ] Got command RPT from MCS: ref #1237961
2019-01-21 11:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237961  77 58504 42666966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:51:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 11:51:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 11:51:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:51:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:51:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:51:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:51:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:51:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:51:42 [DEBUG   ] Finished updating board flags in 2.156 seconds
2019-01-21 11:51:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 11:52:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-21 11:52:38 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 11:52:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:52:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:52:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:52:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:52:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:52:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:52:42 [DEBUG   ] Finished updating board flags in 1.886 seconds
2019-01-21 11:52:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 11:53:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 11:53:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 11:53:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:53:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 11:53:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:53:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:53:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:53:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:53:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:53:42 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-21 11:53:43 [DEBUG   ] Got command RPT from MCS: ref #1237981
2019-01-21 11:53:43 [DEBUG   ] summary = ERROR
2019-01-21 11:53:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237981  13 58504 42823769 A  ERRORERROR'
2019-01-21 11:53:43 [DEBUG   ] Got command RPT from MCS: ref #1237982
2019-01-21 11:53:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:53:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237982  77 58504 42823961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:53:44 [DEBUG   ] Got command RPT from MCS: ref #1237983
2019-01-21 11:53:44 [DEBUG   ] summary = ERROR
2019-01-21 11:53:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237983  13 58504 42824165 A  ERRORERROR'
2019-01-21 11:53:44 [DEBUG   ] Got command RPT from MCS: ref #1237984
2019-01-21 11:53:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:53:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237984  77 58504 42824369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:53:44 [DEBUG   ] Got command RPT from MCS: ref #1237985
2019-01-21 11:53:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 11:53:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237985  12 58504 42824573 A  ERRORB—™š'
2019-01-21 11:53:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 11:54:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 11:54:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 11:54:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:54:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:54:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:54:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:54:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:54:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:54:42 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-21 11:54:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 11:55:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 11:55:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 11:55:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:55:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 11:55:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:55:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:55:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:55:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:55:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:55:42 [DEBUG   ] Finished updating board flags in 1.777 seconds
2019-01-21 11:55:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 11:56:06 [DEBUG   ] Got command RPT from MCS: ref #1237990
2019-01-21 11:56:06 [DEBUG   ] summary = ERROR
2019-01-21 11:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237990  13 58504 42966973 A  ERRORERROR'
2019-01-21 11:56:06 [DEBUG   ] Got command RPT from MCS: ref #1237991
2019-01-21 11:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1237991  77 58504 42966974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:56:18 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-21 11:56:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 11:56:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:56:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:56:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:56:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:56:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:56:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:56:42 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-21 11:56:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 11:57:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 11:57:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 11:57:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:57:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:57:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:57:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:57:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:57:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:57:42 [DEBUG   ] Finished updating board flags in 1.668 seconds
2019-01-21 11:57:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 11:58:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 11:58:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 11:58:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:58:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:58:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:58:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:58:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:58:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:58:42 [DEBUG   ] Finished updating board flags in 1.521 seconds
2019-01-21 11:58:43 [DEBUG   ] Got command RPT from MCS: ref #1238009
2019-01-21 11:58:43 [DEBUG   ] summary = ERROR
2019-01-21 11:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238009  13 58504 43123849 A  ERRORERROR'
2019-01-21 11:58:44 [DEBUG   ] Got command RPT from MCS: ref #1238010
2019-01-21 11:58:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:58:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238010  77 58504 43124053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:58:44 [DEBUG   ] Got command RPT from MCS: ref #1238011
2019-01-21 11:58:44 [DEBUG   ] summary = ERROR
2019-01-21 11:58:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238011  13 58504 43124257 A  ERRORERROR'
2019-01-21 11:58:44 [DEBUG   ] Got command RPT from MCS: ref #1238013
2019-01-21 11:58:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 11:58:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238013  77 58504 43124449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 11:58:44 [DEBUG   ] Got command RPT from MCS: ref #1238014
2019-01-21 11:58:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 11:58:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238014  12 58504 43124653 A  ERRORB–™š'
2019-01-21 11:58:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 11:59:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 11:59:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 11:59:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 11:59:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:59:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:59:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:59:42 [WARNING ] (13, 1, 'bot')
2019-01-21 11:59:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 11:59:42 [DEBUG   ] Finished updating board flags in 1.492 seconds
2019-01-21 11:59:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:00:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:00:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:00:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:00:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 12:00:42 [WARNING ] (13, 1, 'bot')
2019-01-21 12:00:42 [WARNING ] (13, 1, 'bot')
2019-01-21 12:00:42 [WARNING ] (13, 1, 'bot')
2019-01-21 12:00:42 [WARNING ] (13, 1, 'bot')
2019-01-21 12:00:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:00:42 [DEBUG   ] Finished updating board flags in 1.518 seconds
2019-01-21 12:00:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:01:06 [DEBUG   ] Got command RPT from MCS: ref #1238023
2019-01-21 12:01:06 [DEBUG   ] summary = ERROR
2019-01-21 12:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238023  13 58504 43266973 A  ERRORERROR'
2019-01-21 12:01:06 [DEBUG   ] Got command RPT from MCS: ref #1238024
2019-01-21 12:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238024  77 58504 43266974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:01:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:01:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:01:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 12:01:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:01:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 12:01:42 [WARNING ] (13, 1, 'bot')
2019-01-21 12:01:42 [WARNING ] (13, 1, 'bot')
2019-01-21 12:01:42 [WARNING ] (13, 1, 'bot')
2019-01-21 12:01:42 [WARNING ] (13, 1, 'bot')
2019-01-21 12:01:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:01:42 [DEBUG   ] Finished updating board flags in 1.521 seconds
2019-01-21 12:01:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:02:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 12:02:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:02:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 12:02:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:02:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:02:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:02:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:02:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:02:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:02:43 [DEBUG   ] Finished updating board flags in 2.205 seconds
2019-01-21 12:02:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:03:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:03:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:03:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:03:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:03:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:03:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:03:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:03:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:03:43 [DEBUG   ] Finished updating board flags in 2.097 seconds
2019-01-21 12:03:43 [DEBUG   ] Got command RPT from MCS: ref #1238044
2019-01-21 12:03:43 [DEBUG   ] summary = ERROR
2019-01-21 12:03:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238044  13 58504 43423941 A  ERRORERROR'
2019-01-21 12:03:44 [DEBUG   ] Got command RPT from MCS: ref #1238045
2019-01-21 12:03:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:03:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238045  77 58504 43424133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:03:44 [DEBUG   ] Got command RPT from MCS: ref #1238046
2019-01-21 12:03:44 [DEBUG   ] summary = ERROR
2019-01-21 12:03:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238046  13 58504 43424337 A  ERRORERROR'
2019-01-21 12:03:44 [DEBUG   ] Got command RPT from MCS: ref #1238047
2019-01-21 12:03:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:03:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238047  77 58504 43424541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:03:44 [DEBUG   ] Got command RPT from MCS: ref #1238048
2019-01-21 12:03:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 12:03:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238048  12 58504 43424745 A  ERRORB˜™š'
2019-01-21 12:03:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:04:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:04:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:04:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:04:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:04:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:04:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:04:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:04:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:04:43 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-21 12:04:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:05:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:05:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:05:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:05:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:05:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:05:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:05:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:05:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:05:43 [DEBUG   ] Finished updating board flags in 1.972 seconds
2019-01-21 12:05:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:06:06 [DEBUG   ] Got command RPT from MCS: ref #1238053
2019-01-21 12:06:06 [DEBUG   ] summary = ERROR
2019-01-21 12:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238053  13 58504 43566969 A  ERRORERROR'
2019-01-21 12:06:06 [DEBUG   ] Got command RPT from MCS: ref #1238054
2019-01-21 12:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238054  77 58504 43566970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:06:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:06:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:06:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:06:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:06:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:06:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:06:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:06:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:06:43 [DEBUG   ] Finished updating board flags in 1.830 seconds
2019-01-21 12:06:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:07:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:07:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:07:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:07:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:07:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:07:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:07:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:07:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:07:43 [DEBUG   ] Finished updating board flags in 1.838 seconds
2019-01-21 12:07:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:08:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:08:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:08:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:08:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:08:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:08:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:08:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:08:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:08:43 [DEBUG   ] Finished updating board flags in 1.856 seconds
2019-01-21 12:08:44 [DEBUG   ] Got command RPT from MCS: ref #1238076
2019-01-21 12:08:44 [DEBUG   ] summary = ERROR
2019-01-21 12:08:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238076  13 58504 43724021 A  ERRORERROR'
2019-01-21 12:08:44 [DEBUG   ] Got command RPT from MCS: ref #1238077
2019-01-21 12:08:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:08:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238077  77 58504 43724225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:08:44 [DEBUG   ] Got command RPT from MCS: ref #1238078
2019-01-21 12:08:44 [DEBUG   ] summary = ERROR
2019-01-21 12:08:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238078  13 58504 43724417 A  ERRORERROR'
2019-01-21 12:08:44 [DEBUG   ] Got command RPT from MCS: ref #1238080
2019-01-21 12:08:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:08:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238080  77 58504 43724621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:08:44 [DEBUG   ] Got command RPT from MCS: ref #1238081
2019-01-21 12:08:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 12:08:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238081  12 58504 43724825 A  ERRORB—™š'
2019-01-21 12:08:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:09:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:09:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:09:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:09:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:09:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:09:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:09:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:09:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:09:43 [DEBUG   ] Finished updating board flags in 1.690 seconds
2019-01-21 12:09:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:10:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 12:10:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:10:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:10:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:10:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:10:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:10:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:10:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:10:43 [DEBUG   ] Finished updating board flags in 1.627 seconds
2019-01-21 12:10:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:11:06 [DEBUG   ] Got command RPT from MCS: ref #1238090
2019-01-21 12:11:06 [DEBUG   ] summary = ERROR
2019-01-21 12:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238090  13 58504 43866977 A  ERRORERROR'
2019-01-21 12:11:06 [DEBUG   ] Got command RPT from MCS: ref #1238091
2019-01-21 12:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238091  77 58504 43866978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:11:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:11:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:11:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:11:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 12:11:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:11:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:11:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:11:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:11:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:11:43 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-01-21 12:11:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:12:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:12:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:12:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:12:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:12:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:12:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:12:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:12:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:12:43 [DEBUG   ] Finished updating board flags in 1.496 seconds
2019-01-21 12:12:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:13:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:13:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:13:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:13:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:13:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:13:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:13:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:13:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:13:43 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-21 12:13:44 [DEBUG   ] Got command RPT from MCS: ref #1238107
2019-01-21 12:13:44 [DEBUG   ] summary = ERROR
2019-01-21 12:13:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238107  13 58504 44024109 A  ERRORERROR'
2019-01-21 12:13:44 [DEBUG   ] Got command RPT from MCS: ref #1238108
2019-01-21 12:13:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:13:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238108  77 58504 44024313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:13:44 [DEBUG   ] Got command RPT from MCS: ref #1238109
2019-01-21 12:13:44 [DEBUG   ] summary = ERROR
2019-01-21 12:13:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238109  13 58504 44024505 A  ERRORERROR'
2019-01-21 12:13:44 [DEBUG   ] Got command RPT from MCS: ref #1238110
2019-01-21 12:13:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:13:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238110  77 58504 44024709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:13:44 [DEBUG   ] Got command RPT from MCS: ref #1238111
2019-01-21 12:13:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 12:13:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238111  12 58504 44024913 A  ERRORB–™š'
2019-01-21 12:13:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:14:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 12:14:38 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-21 12:14:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:14:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:14:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:14:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:14:43 [WARNING ] (13, 1, 'bot')
2019-01-21 12:14:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:14:43 [DEBUG   ] Finished updating board flags in 1.326 seconds
2019-01-21 12:14:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 12:15:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:15:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:15:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:15:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:15:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:15:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:15:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:15:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:15:44 [DEBUG   ] Finished updating board flags in 2.187 seconds
2019-01-21 12:15:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 12:16:06 [DEBUG   ] Got command RPT from MCS: ref #1238116
2019-01-21 12:16:06 [DEBUG   ] summary = ERROR
2019-01-21 12:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238116  13 58504 44166977 A  ERRORERROR'
2019-01-21 12:16:06 [DEBUG   ] Got command RPT from MCS: ref #1238117
2019-01-21 12:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238117  77 58504 44166978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:16:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 12:16:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:16:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 12:16:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:16:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:16:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:16:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:16:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:16:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:16:44 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-21 12:16:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:17:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 12:17:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 12:17:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:17:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:17:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:17:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:17:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:17:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:17:44 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-21 12:17:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:18:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 12:18:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:18:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:18:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 12:18:44 [DEBUG   ] Got command RPT from MCS: ref #1238139
2019-01-21 12:18:44 [DEBUG   ] summary = ERROR
2019-01-21 12:18:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238139  13 58504 44324194 A  ERRORERROR'
2019-01-21 12:18:44 [DEBUG   ] Got command RPT from MCS: ref #1238140
2019-01-21 12:18:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:18:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238140  77 58504 44324397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:18:44 [DEBUG   ] Got command RPT from MCS: ref #1238141
2019-01-21 12:18:44 [DEBUG   ] summary = ERROR
2019-01-21 12:18:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238141  13 58504 44324590 A  ERRORERROR'
2019-01-21 12:18:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:18:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:18:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:18:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:18:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:18:44 [DEBUG   ] Finished updating board flags in 1.893 seconds
2019-01-21 12:18:44 [DEBUG   ] Got command RPT from MCS: ref #1238143
2019-01-21 12:18:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:18:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238143  77 58504 44324797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:18:44 [DEBUG   ] Got command RPT from MCS: ref #1238144
2019-01-21 12:18:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 12:18:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238144  12 58504 44324989 A  ERRORB˜™š'
2019-01-21 12:18:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 12:19:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:19:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 12:19:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:19:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:19:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:19:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:19:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:19:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:19:44 [DEBUG   ] Finished updating board flags in 1.706 seconds
2019-01-21 12:19:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:20:18 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-21 12:20:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 12:20:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 12:20:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:20:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:20:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:20:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:20:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:20:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:20:44 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-21 12:20:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 12:21:06 [DEBUG   ] Got command RPT from MCS: ref #1238153
2019-01-21 12:21:06 [DEBUG   ] summary = ERROR
2019-01-21 12:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238153  13 58504 44466973 A  ERRORERROR'
2019-01-21 12:21:06 [DEBUG   ] Got command RPT from MCS: ref #1238154
2019-01-21 12:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238154  77 58504 44466974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:21:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 12:21:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 12:21:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:21:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:21:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:21:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:21:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:21:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:21:44 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-01-21 12:21:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 12:22:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 12:22:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 12:22:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:22:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:22:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:22:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:22:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:22:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:22:44 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-21 12:22:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 12:23:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 12:23:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 12:23:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:23:44 [DEBUG   ] Got command RPT from MCS: ref #1238174
2019-01-21 12:23:44 [DEBUG   ] summary = ERROR
2019-01-21 12:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238174  13 58504 44624274 A  ERRORERROR'
2019-01-21 12:23:44 [DEBUG   ] Got command RPT from MCS: ref #1238175
2019-01-21 12:23:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238175  77 58504 44624478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:23:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:23:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:23:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:23:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:23:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:23:44 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-21 12:23:44 [DEBUG   ] Got command RPT from MCS: ref #1238176
2019-01-21 12:23:44 [DEBUG   ] summary = ERROR
2019-01-21 12:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238176  13 58504 44624681 A  ERRORERROR'
2019-01-21 12:23:44 [DEBUG   ] Got command RPT from MCS: ref #1238177
2019-01-21 12:23:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:23:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238177  77 58504 44624877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:23:45 [DEBUG   ] Got command RPT from MCS: ref #1238178
2019-01-21 12:23:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 12:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238178  12 58504 44625081 A  ERRORB—™š'
2019-01-21 12:23:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 12:24:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 12:24:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 12:24:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:24:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:24:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:24:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:24:44 [WARNING ] (13, 1, 'bot')
2019-01-21 12:24:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:24:44 [DEBUG   ] Finished updating board flags in 1.541 seconds
2019-01-21 12:24:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 12:25:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 12:25:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 12:25:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:25:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:25:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:25:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:25:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:25:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:25:45 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-21 12:25:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 12:26:06 [DEBUG   ] Got command RPT from MCS: ref #1238183
2019-01-21 12:26:06 [DEBUG   ] summary = ERROR
2019-01-21 12:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238183  13 58504 44766969 A  ERRORERROR'
2019-01-21 12:26:06 [DEBUG   ] Got command RPT from MCS: ref #1238184
2019-01-21 12:26:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:26:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238184  77 58504 44766970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:26:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 12:26:38 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-21 12:26:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:26:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:26:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:26:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:26:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:26:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:26:45 [DEBUG   ] Finished updating board flags in 2.172 seconds
2019-01-21 12:26:58 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-21 12:27:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 12:27:39 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 12:27:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:27:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:27:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:27:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:27:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:27:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:27:45 [DEBUG   ] Finished updating board flags in 1.891 seconds
2019-01-21 12:27:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 12:28:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 12:28:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 12:28:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 12:28:44 [DEBUG   ] Got command RPT from MCS: ref #1238202
2019-01-21 12:28:44 [DEBUG   ] summary = ERROR
2019-01-21 12:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238202  13 58504 44924358 A  ERRORERROR'
2019-01-21 12:28:44 [DEBUG   ] Got command RPT from MCS: ref #1238203
2019-01-21 12:28:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238203  77 58504 44924566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:28:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:28:44 [DEBUG   ] Got command RPT from MCS: ref #1238204
2019-01-21 12:28:44 [DEBUG   ] summary = ERROR
2019-01-21 12:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238204  13 58504 44924769 A  ERRORERROR'
2019-01-21 12:28:44 [DEBUG   ] Got command RPT from MCS: ref #1238206
2019-01-21 12:28:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238206  77 58504 44924961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:28:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 12:28:45 [DEBUG   ] Got command RPT from MCS: ref #1238207
2019-01-21 12:28:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 12:28:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238207  12 58504 44925170 A  ERRORB�™š'
2019-01-21 12:28:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:28:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:28:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:28:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:28:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:28:45 [DEBUG   ] Finished updating board flags in 1.797 seconds
2019-01-21 12:28:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 12:29:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 12:29:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 12:29:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:29:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:29:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:29:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:29:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:29:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:29:45 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-21 12:29:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 12:30:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-21 12:30:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:30:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 12:30:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:30:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:30:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:30:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:30:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:30:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:30:45 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-21 12:30:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:31:06 [DEBUG   ] Got command RPT from MCS: ref #1238216
2019-01-21 12:31:06 [DEBUG   ] summary = ERROR
2019-01-21 12:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238216  13 58504 45066981 A  ERRORERROR'
2019-01-21 12:31:06 [DEBUG   ] Got command RPT from MCS: ref #1238217
2019-01-21 12:31:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238217  77 58504 45066982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:31:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:31:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:31:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:31:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 12:31:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:31:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:31:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:31:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:31:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:31:45 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-21 12:31:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:32:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:32:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:32:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:32:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:32:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:32:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:32:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:32:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:32:45 [DEBUG   ] Finished updating board flags in 1.460 seconds
2019-01-21 12:32:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:33:19 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-21 12:33:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:33:44 [DEBUG   ] Got command RPT from MCS: ref #1238237
2019-01-21 12:33:44 [DEBUG   ] summary = ERROR
2019-01-21 12:33:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238237  13 58504 45224449 A  ERRORERROR'
2019-01-21 12:33:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 12:33:44 [DEBUG   ] Got command RPT from MCS: ref #1238238
2019-01-21 12:33:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:33:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238238  77 58504 45224653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:33:44 [DEBUG   ] Got command RPT from MCS: ref #1238239
2019-01-21 12:33:44 [DEBUG   ] summary = ERROR
2019-01-21 12:33:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238239  13 58504 45224857 A  ERRORERROR'
2019-01-21 12:33:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:33:45 [DEBUG   ] Got command RPT from MCS: ref #1238240
2019-01-21 12:33:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:33:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238240  77 58504 45225049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:33:45 [DEBUG   ] Got command RPT from MCS: ref #1238241
2019-01-21 12:33:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 12:33:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238241  12 58504 45225258 A  ERRORB’™š'
2019-01-21 12:33:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:33:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:33:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:33:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:33:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:33:45 [DEBUG   ] Finished updating board flags in 1.463 seconds
2019-01-21 12:33:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:34:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:34:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:34:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:34:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:34:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:34:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:34:45 [WARNING ] (13, 1, 'bot')
2019-01-21 12:34:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:34:45 [DEBUG   ] Finished updating board flags in 1.568 seconds
2019-01-21 12:34:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:35:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:35:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 12:35:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:35:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:35:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:35:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:35:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:35:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:35:46 [DEBUG   ] Finished updating board flags in 2.236 seconds
2019-01-21 12:35:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:36:06 [DEBUG   ] Got command RPT from MCS: ref #1238246
2019-01-21 12:36:06 [DEBUG   ] summary = ERROR
2019-01-21 12:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238246  13 58504 45366981 A  ERRORERROR'
2019-01-21 12:36:06 [DEBUG   ] Got command RPT from MCS: ref #1238247
2019-01-21 12:36:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:36:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238247  77 58504 45366982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:36:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:36:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 12:36:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:36:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:36:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:36:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:36:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:36:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:36:46 [DEBUG   ] Finished updating board flags in 2.085 seconds
2019-01-21 12:36:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:37:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:37:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 12:37:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:37:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:37:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:37:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:37:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:37:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:37:46 [DEBUG   ] Finished updating board flags in 2.021 seconds
2019-01-21 12:37:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:38:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:38:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:38:44 [DEBUG   ] Got command RPT from MCS: ref #1238269
2019-01-21 12:38:44 [DEBUG   ] summary = ERROR
2019-01-21 12:38:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238269  13 58504 45524533 A  ERRORERROR'
2019-01-21 12:38:44 [DEBUG   ] Got command RPT from MCS: ref #1238270
2019-01-21 12:38:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:38:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238270  77 58504 45524737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:38:44 [DEBUG   ] Got command RPT from MCS: ref #1238271
2019-01-21 12:38:44 [DEBUG   ] summary = ERROR
2019-01-21 12:38:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238271  13 58504 45524941 A  ERRORERROR'
2019-01-21 12:38:45 [DEBUG   ] Got command RPT from MCS: ref #1238273
2019-01-21 12:38:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:38:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238273  77 58504 45525134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:38:45 [DEBUG   ] Got command RPT from MCS: ref #1238274
2019-01-21 12:38:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 12:38:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238274  12 58504 45525337 A  ERRORB‚'
2019-01-21 12:38:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:38:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-01-21 12:38:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:38:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:38:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:38:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:38:46 [WARNING ] (25, 5, 'bot')
2019-01-21 12:38:46 [WARNING ] (25, 5, 'bot')
2019-01-21 12:38:46 [WARNING ] (25, 5, 'bot')
2019-01-21 12:38:46 [WARNING ] (25, 5, 'bot')
2019-01-21 12:38:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:38:46 [DEBUG   ] Finished updating board flags in 1.973 seconds
2019-01-21 12:38:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 12:39:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 12:39:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:39:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:39:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:39:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:39:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:39:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:39:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:39:46 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-21 12:39:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 12:40:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 12:40:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 12:40:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:40:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:40:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:40:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:40:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:40:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:40:46 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-21 12:40:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 12:41:06 [DEBUG   ] Got command RPT from MCS: ref #1238283
2019-01-21 12:41:06 [DEBUG   ] summary = ERROR
2019-01-21 12:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238283  13 58504 45666977 A  ERRORERROR'
2019-01-21 12:41:06 [DEBUG   ] Got command RPT from MCS: ref #1238284
2019-01-21 12:41:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238284  77 58504 45666978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:41:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 12:41:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 12:41:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:41:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:41:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:41:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:41:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:41:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:41:46 [DEBUG   ] Finished updating board flags in 1.701 seconds
2019-01-21 12:41:59 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-21 12:42:19 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-21 12:42:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 12:42:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:42:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:42:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:42:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:42:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:42:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:42:46 [DEBUG   ] Finished updating board flags in 1.488 seconds
2019-01-21 12:43:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-21 12:43:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 12:43:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 12:43:44 [DEBUG   ] Got command RPT from MCS: ref #1238300
2019-01-21 12:43:44 [DEBUG   ] summary = ERROR
2019-01-21 12:43:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238300  13 58504 45824629 A  ERRORERROR'
2019-01-21 12:43:44 [DEBUG   ] Got command RPT from MCS: ref #1238301
2019-01-21 12:43:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:43:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238301  77 58504 45824821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:43:45 [DEBUG   ] Got command RPT from MCS: ref #1238302
2019-01-21 12:43:45 [DEBUG   ] summary = ERROR
2019-01-21 12:43:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238302  13 58504 45825025 A  ERRORERROR'
2019-01-21 12:43:45 [DEBUG   ] Got command RPT from MCS: ref #1238303
2019-01-21 12:43:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:43:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238303  77 58504 45825229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:43:45 [DEBUG   ] Got command RPT from MCS: ref #1238304
2019-01-21 12:43:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 12:43:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238304  12 58504 45825425 A  ERRORB„'
2019-01-21 12:43:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 12:43:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:43:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:43:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:43:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:43:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:43:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:43:46 [DEBUG   ] Finished updating board flags in 1.459 seconds
2019-01-21 12:44:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 12:44:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-21 12:44:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:44:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:44:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 12:44:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:44:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:44:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:44:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:44:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:44:46 [DEBUG   ] Finished updating board flags in 1.442 seconds
2019-01-21 12:45:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:45:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:45:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:45:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:45:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:45:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:45:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:45:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:45:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:45:46 [DEBUG   ] Finished updating board flags in 1.460 seconds
2019-01-21 12:46:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:46:06 [DEBUG   ] Got command RPT from MCS: ref #1238309
2019-01-21 12:46:06 [DEBUG   ] summary = ERROR
2019-01-21 12:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238309  13 58504 45966981 A  ERRORERROR'
2019-01-21 12:46:06 [DEBUG   ] Got command RPT from MCS: ref #1238310
2019-01-21 12:46:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238310  77 58504 45966982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:46:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:46:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:46:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:46:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 12:46:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:46:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:46:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:46:46 [WARNING ] (13, 1, 'bot')
2019-01-21 12:46:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:46:46 [DEBUG   ] Finished updating board flags in 1.464 seconds
2019-01-21 12:47:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:47:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 12:47:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:47:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:47:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:47:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:47:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:47:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:47:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:47:47 [DEBUG   ] Finished updating board flags in 2.212 seconds
2019-01-21 12:48:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 12:48:20 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2019-01-21 12:48:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:48:44 [DEBUG   ] Got command RPT from MCS: ref #1238332
2019-01-21 12:48:44 [DEBUG   ] summary = ERROR
2019-01-21 12:48:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238332  13 58504 46124713 A  ERRORERROR'
2019-01-21 12:48:44 [DEBUG   ] Got command RPT from MCS: ref #1238333
2019-01-21 12:48:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:48:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238333  77 58504 46124905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:48:45 [DEBUG   ] Got command RPT from MCS: ref #1238334
2019-01-21 12:48:45 [DEBUG   ] summary = ERROR
2019-01-21 12:48:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238334  13 58504 46125109 A  ERRORERROR'
2019-01-21 12:48:45 [DEBUG   ] Got command RPT from MCS: ref #1238336
2019-01-21 12:48:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:48:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238336  77 58504 46125313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:48:45 [DEBUG   ] Got command RPT from MCS: ref #1238338
2019-01-21 12:48:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 12:48:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238338  12 58504 46125518 A  ERRORB˜™š'
2019-01-21 12:48:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:48:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:48:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:48:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:48:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:48:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:48:47 [DEBUG   ] Finished updating board flags in 2.183 seconds
2019-01-21 12:49:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:49:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 12:49:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:49:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:49:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:49:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:49:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:49:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:49:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:49:47 [DEBUG   ] Finished updating board flags in 2.102 seconds
2019-01-21 12:50:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:50:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:50:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-21 12:50:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:50:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:50:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:50:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:50:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:50:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:50:47 [DEBUG   ] Finished updating board flags in 1.921 seconds
2019-01-21 12:51:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-21 12:51:06 [DEBUG   ] Got command RPT from MCS: ref #1238346
2019-01-21 12:51:06 [DEBUG   ] summary = ERROR
2019-01-21 12:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238346  13 58504 46266985 A  ERRORERROR'
2019-01-21 12:51:06 [DEBUG   ] Got command RPT from MCS: ref #1238347
2019-01-21 12:51:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238347  77 58504 46266986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:51:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:51:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:51:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:51:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:51:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:51:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:51:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:51:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:51:47 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-21 12:52:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:52:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:52:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:52:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:52:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:52:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:52:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:52:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:52:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:52:47 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-21 12:53:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 12:53:20 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-21 12:53:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 12:53:44 [DEBUG   ] Got command RPT from MCS: ref #1238367
2019-01-21 12:53:44 [DEBUG   ] summary = ERROR
2019-01-21 12:53:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238367  13 58504 46424793 A  ERRORERROR'
2019-01-21 12:53:44 [DEBUG   ] Got command RPT from MCS: ref #1238368
2019-01-21 12:53:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:53:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238368  77 58504 46424997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:53:45 [DEBUG   ] Got command RPT from MCS: ref #1238369
2019-01-21 12:53:45 [DEBUG   ] summary = ERROR
2019-01-21 12:53:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238369  13 58504 46425201 A  ERRORERROR'
2019-01-21 12:53:45 [DEBUG   ] Got command RPT from MCS: ref #1238370
2019-01-21 12:53:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:53:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238370  77 58504 46425393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:53:45 [DEBUG   ] Got command RPT from MCS: ref #1238371
2019-01-21 12:53:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 12:53:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238371  12 58504 46425597 A  ERRORB–™š'
2019-01-21 12:53:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:53:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:53:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:53:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:53:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:53:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:53:47 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-21 12:54:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 12:54:20 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-21 12:54:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 12:54:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:54:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:54:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:54:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:54:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:54:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:54:47 [DEBUG   ] Finished updating board flags in 1.473 seconds
2019-01-21 12:55:01 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 12:55:21 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-21 12:55:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 12:55:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:55:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:55:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:55:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:55:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:55:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:55:47 [DEBUG   ] Finished updating board flags in 1.474 seconds
2019-01-21 12:56:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-21 12:56:06 [DEBUG   ] Got command RPT from MCS: ref #1238376
2019-01-21 12:56:06 [DEBUG   ] summary = ERROR
2019-01-21 12:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238376  13 58504 46566981 A  ERRORERROR'
2019-01-21 12:56:06 [DEBUG   ] Got command RPT from MCS: ref #1238377
2019-01-21 12:56:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238377  77 58504 46566982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:56:21 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-21 12:56:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 12:56:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:56:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:56:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:56:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:56:47 [WARNING ] (13, 1, 'bot')
2019-01-21 12:56:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:56:47 [DEBUG   ] Finished updating board flags in 1.491 seconds
2019-01-21 12:57:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-21 12:57:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-21 12:57:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-21 12:57:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:57:48 [WARNING ] (13, 1, 'bot')
2019-01-21 12:57:48 [WARNING ] (13, 1, 'bot')
2019-01-21 12:57:48 [WARNING ] (13, 1, 'bot')
2019-01-21 12:57:48 [WARNING ] (13, 1, 'bot')
2019-01-21 12:57:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:57:48 [DEBUG   ] Finished updating board flags in 2.170 seconds
2019-01-21 12:58:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-21 12:58:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-21 12:58:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 12:58:44 [DEBUG   ] Got command RPT from MCS: ref #1238395
2019-01-21 12:58:44 [DEBUG   ] summary = ERROR
2019-01-21 12:58:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238395  13 58504 46724877 A  ERRORERROR'
2019-01-21 12:58:45 [DEBUG   ] Got command RPT from MCS: ref #1238396
2019-01-21 12:58:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:58:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238396  77 58504 46725081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:58:45 [DEBUG   ] Got command RPT from MCS: ref #1238397
2019-01-21 12:58:45 [DEBUG   ] summary = ERROR
2019-01-21 12:58:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238397  13 58504 46725285 A  ERRORERROR'
2019-01-21 12:58:45 [DEBUG   ] Got command RPT from MCS: ref #1238399
2019-01-21 12:58:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 12:58:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238399  77 58504 46725489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 12:58:45 [DEBUG   ] Got command RPT from MCS: ref #1238400
2019-01-21 12:58:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 12:58:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238400  12 58504 46725681 A  ERRORB–™š'
2019-01-21 12:58:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-21 12:58:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:58:48 [WARNING ] (13, 1, 'bot')
2019-01-21 12:58:48 [WARNING ] (13, 1, 'bot')
2019-01-21 12:58:48 [WARNING ] (13, 1, 'bot')
2019-01-21 12:58:48 [WARNING ] (13, 1, 'bot')
2019-01-21 12:58:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:58:48 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-21 12:59:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 12:59:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 12:59:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-21 12:59:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 12:59:48 [WARNING ] (13, 1, 'bot')
2019-01-21 12:59:48 [WARNING ] (13, 1, 'bot')
2019-01-21 12:59:48 [WARNING ] (13, 1, 'bot')
2019-01-21 12:59:48 [WARNING ] (13, 1, 'bot')
2019-01-21 12:59:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 12:59:48 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-21 13:00:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 13:00:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 13:00:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-21 13:00:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 13:00:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:00:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:00:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:00:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:00:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:00:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:00:48 [DEBUG   ] Finished updating board flags in 1.801 seconds
2019-01-21 13:01:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-21 13:01:06 [DEBUG   ] Got command RPT from MCS: ref #1238409
2019-01-21 13:01:06 [DEBUG   ] summary = ERROR
2019-01-21 13:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238409  13 58504 46866989 A  ERRORERROR'
2019-01-21 13:01:06 [DEBUG   ] Got command RPT from MCS: ref #1238410
2019-01-21 13:01:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:01:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238410  77 58504 46866990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:01:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 13:01:42 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-21 13:01:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:01:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:01:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:01:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:01:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:01:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:01:48 [DEBUG   ] Finished updating board flags in 1.803 seconds
2019-01-21 13:02:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 13:02:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 13:02:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 13:02:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:02:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:02:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:02:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:02:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:02:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:02:48 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-21 13:03:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 13:03:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 13:03:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 13:03:44 [DEBUG   ] Got command RPT from MCS: ref #1238430
2019-01-21 13:03:44 [DEBUG   ] summary = ERROR
2019-01-21 13:03:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238430  13 58504 47024965 A  ERRORERROR'
2019-01-21 13:03:45 [DEBUG   ] Got command RPT from MCS: ref #1238431
2019-01-21 13:03:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:03:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238431  77 58504 47025169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:03:45 [DEBUG   ] Got command RPT from MCS: ref #1238432
2019-01-21 13:03:45 [DEBUG   ] summary = ERROR
2019-01-21 13:03:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238432  13 58504 47025373 A  ERRORERROR'
2019-01-21 13:03:45 [DEBUG   ] Got command RPT from MCS: ref #1238433
2019-01-21 13:03:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:03:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238433  77 58504 47025582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:03:45 [DEBUG   ] Got command RPT from MCS: ref #1238434
2019-01-21 13:03:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 13:03:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238434  12 58504 47025773 A  ERRORB˜™š'
2019-01-21 13:03:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:03:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:03:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:03:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:03:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:03:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:03:48 [DEBUG   ] Finished updating board flags in 1.851 seconds
2019-01-21 13:04:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 13:04:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 13:04:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 13:04:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:04:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:04:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:04:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:04:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:04:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:04:48 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-21 13:05:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 13:05:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 13:05:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 13:05:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:05:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:05:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:05:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:05:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:05:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:05:48 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-21 13:06:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 13:06:06 [DEBUG   ] Got command RPT from MCS: ref #1238439
2019-01-21 13:06:06 [DEBUG   ] summary = ERROR
2019-01-21 13:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238439  13 58504 47166989 A  ERRORERROR'
2019-01-21 13:06:06 [DEBUG   ] Got command RPT from MCS: ref #1238440
2019-01-21 13:06:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:06:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238440  77 58504 47166990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:06:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 13:06:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 13:06:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:06:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 13:06:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-21 13:06:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:06:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:06:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:06:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:06:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:06:48 [DEBUG   ] Finished updating board flags in 1.532 seconds
2019-01-21 13:07:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 13:07:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 13:07:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 13:07:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:07:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:07:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:07:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:07:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:07:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:07:48 [DEBUG   ] Finished updating board flags in 1.489 seconds
2019-01-21 13:08:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 13:08:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 13:08:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 13:08:45 [DEBUG   ] Got command RPT from MCS: ref #1238462
2019-01-21 13:08:45 [DEBUG   ] summary = ERROR
2019-01-21 13:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238462  13 58504 47325049 A  ERRORERROR'
2019-01-21 13:08:45 [DEBUG   ] Got command RPT from MCS: ref #1238463
2019-01-21 13:08:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238463  77 58504 47325253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:08:45 [DEBUG   ] Got command RPT from MCS: ref #1238464
2019-01-21 13:08:45 [DEBUG   ] summary = ERROR
2019-01-21 13:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238464  13 58504 47325457 A  ERRORERROR'
2019-01-21 13:08:45 [DEBUG   ] Got command RPT from MCS: ref #1238466
2019-01-21 13:08:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238466  77 58504 47325661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:08:45 [DEBUG   ] Got command RPT from MCS: ref #1238467
2019-01-21 13:08:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 13:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238467  12 58504 47325853 A  ERRORB–™š'
2019-01-21 13:08:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:08:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:08:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:08:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:08:48 [WARNING ] (13, 1, 'bot')
2019-01-21 13:08:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:08:48 [DEBUG   ] Finished updating board flags in 1.549 seconds
2019-01-21 13:09:02 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-21 13:09:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 13:09:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 13:09:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:09:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:09:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:09:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:09:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:09:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:09:49 [DEBUG   ] Finished updating board flags in 2.237 seconds
2019-01-21 13:10:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-21 13:10:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 13:10:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 13:10:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:10:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:10:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:10:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:10:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:10:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:10:49 [DEBUG   ] Finished updating board flags in 2.120 seconds
2019-01-21 13:11:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 13:11:06 [DEBUG   ] Got command RPT from MCS: ref #1238476
2019-01-21 13:11:06 [DEBUG   ] summary = ERROR
2019-01-21 13:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238476  13 58504 47466981 A  ERRORERROR'
2019-01-21 13:11:06 [DEBUG   ] Got command RPT from MCS: ref #1238477
2019-01-21 13:11:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:11:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238477  77 58504 47466982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:11:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 13:11:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 13:11:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:11:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:11:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:11:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:11:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:11:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:11:49 [DEBUG   ] Finished updating board flags in 2.075 seconds
2019-01-21 13:12:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 13:12:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 13:12:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 13:12:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:12:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:12:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:12:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:12:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:12:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:12:49 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-21 13:13:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 13:13:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 13:13:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 13:13:45 [DEBUG   ] Got command RPT from MCS: ref #1238493
2019-01-21 13:13:45 [DEBUG   ] summary = ERROR
2019-01-21 13:13:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238493  13 58504 47625145 A  ERRORERROR'
2019-01-21 13:13:45 [DEBUG   ] Got command RPT from MCS: ref #1238494
2019-01-21 13:13:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:13:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238494  77 58504 47625337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:13:45 [DEBUG   ] Got command RPT from MCS: ref #1238495
2019-01-21 13:13:45 [DEBUG   ] summary = ERROR
2019-01-21 13:13:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238495  13 58504 47625541 A  ERRORERROR'
2019-01-21 13:13:45 [DEBUG   ] Got command RPT from MCS: ref #1238496
2019-01-21 13:13:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:13:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238496  77 58504 47625745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:13:45 [DEBUG   ] Got command RPT from MCS: ref #1238497
2019-01-21 13:13:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 13:13:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238497  12 58504 47625949 A  ERRORB•™š'
2019-01-21 13:13:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:13:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:13:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:13:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:13:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:13:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:13:49 [DEBUG   ] Finished updating board flags in 1.936 seconds
2019-01-21 13:14:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 13:14:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 13:14:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-21 13:14:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:14:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:14:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:14:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:14:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:14:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:14:49 [DEBUG   ] Finished updating board flags in 1.828 seconds
2019-01-21 13:15:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 13:15:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 13:15:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 13:15:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:15:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:15:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:15:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:15:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:15:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:15:49 [DEBUG   ] Finished updating board flags in 1.832 seconds
2019-01-21 13:16:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 13:16:06 [DEBUG   ] Got command RPT from MCS: ref #1238502
2019-01-21 13:16:06 [DEBUG   ] summary = ERROR
2019-01-21 13:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238502  13 58504 47766993 A  ERRORERROR'
2019-01-21 13:16:06 [DEBUG   ] Got command RPT from MCS: ref #1238503
2019-01-21 13:16:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238503  77 58504 47766994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:16:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 13:16:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-21 13:16:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:16:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 13:16:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:16:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:16:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:16:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:16:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:16:49 [DEBUG   ] Finished updating board flags in 1.764 seconds
2019-01-21 13:17:03 [DEBUG   ] Finished updating ant stats in 1.997 seconds
2019-01-21 13:17:22 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-01-21 13:17:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-21 13:17:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:17:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:17:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:17:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:17:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:17:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:17:49 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-01-21 13:18:02 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-21 13:18:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 13:18:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-21 13:18:45 [DEBUG   ] Got command RPT from MCS: ref #1238525
2019-01-21 13:18:45 [DEBUG   ] summary = ERROR
2019-01-21 13:18:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238525  13 58504 47925225 A  ERRORERROR'
2019-01-21 13:18:45 [DEBUG   ] Got command RPT from MCS: ref #1238526
2019-01-21 13:18:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:18:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238526  77 58504 47925429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:18:45 [DEBUG   ] Got command RPT from MCS: ref #1238527
2019-01-21 13:18:45 [DEBUG   ] summary = ERROR
2019-01-21 13:18:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238527  13 58504 47925621 A  ERRORERROR'
2019-01-21 13:18:45 [DEBUG   ] Got command RPT from MCS: ref #1238529
2019-01-21 13:18:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:18:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238529  77 58504 47925825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:18:46 [DEBUG   ] Got command RPT from MCS: ref #1238530
2019-01-21 13:18:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 13:18:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238530  12 58504 47926029 A  ERRORB—™š'
2019-01-21 13:18:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:18:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:18:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:18:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:18:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:18:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:18:49 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-21 13:19:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-21 13:19:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-21 13:19:43 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-21 13:19:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 13:19:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:19:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:19:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:19:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:19:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:19:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:19:49 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-21 13:20:03 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-21 13:20:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 13:20:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 13:20:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 13:20:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:20:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:20:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:20:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:20:49 [WARNING ] (13, 1, 'bot')
2019-01-21 13:20:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:20:49 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-01-21 13:21:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 13:21:06 [DEBUG   ] Got command RPT from MCS: ref #1238539
2019-01-21 13:21:06 [DEBUG   ] summary = ERROR
2019-01-21 13:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238539  13 58504 48066985 A  ERRORERROR'
2019-01-21 13:21:06 [DEBUG   ] Got command RPT from MCS: ref #1238540
2019-01-21 13:21:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238540  77 58504 48066986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:21:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 13:21:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 13:21:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-21 13:21:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:21:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-21 13:21:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:21:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:21:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:21:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:21:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:21:50 [DEBUG   ] Finished updating board flags in 2.082 seconds
2019-01-21 13:22:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 13:22:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 13:22:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-21 13:22:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:22:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:22:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:22:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:22:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:22:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:22:50 [DEBUG   ] Finished updating board flags in 2.028 seconds
2019-01-21 13:23:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-21 13:23:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 13:23:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-21 13:23:45 [DEBUG   ] Got command RPT from MCS: ref #1238560
2019-01-21 13:23:45 [DEBUG   ] summary = ERROR
2019-01-21 13:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238560  13 58504 48225317 A  ERRORERROR'
2019-01-21 13:23:45 [DEBUG   ] Got command RPT from MCS: ref #1238561
2019-01-21 13:23:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238561  77 58504 48225509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:23:45 [DEBUG   ] Got command RPT from MCS: ref #1238562
2019-01-21 13:23:45 [DEBUG   ] summary = ERROR
2019-01-21 13:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238562  13 58504 48225713 A  ERRORERROR'
2019-01-21 13:23:45 [DEBUG   ] Got command RPT from MCS: ref #1238563
2019-01-21 13:23:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-21 13:23:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238563  77 58504 48225917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-21 13:23:46 [DEBUG   ] Got command RPT from MCS: ref #1238564
2019-01-21 13:23:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-21 13:23:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1238564  12 58504 48226127 A  ERRORB—™š'
2019-01-21 13:23:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:23:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:23:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:23:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:23:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:23:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:23:50 [DEBUG   ] Finished updating board flags in 1.939 seconds
2019-01-21 13:24:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-21 13:24:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-21 13:24:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-21 13:24:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-21 13:24:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:24:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:24:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:24:50 [WARNING ] (13, 1, 'bot')
2019-01-21 13:24:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-21 13:24:50 [DEBUG   ] Finished updating board flags in 1.828 seconds
